[ 557.191601] env[69188]: INFO neutron.common.config [-] Logging enabled! [ 557.191874] env[69188]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 26.1.0.dev73 [ 557.192057] env[69188]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=69188) setup_logging /opt/stack/neutron/neutron/common/config.py:124}} [ 557.192360] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ... [ 557.192444] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed. [ 557.193250] env[69188]: WARNING oslo_policy.policy [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. [ 557.193463] env[69188]: WARNING oslo_policy.policy [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. [ 557.194926] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] VMware NSXv3 Agent initialized successfully. [ 557.195297] env[69188]: DEBUG oslo_concurrency.lockutils [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] Acquiring lock "singleton_lock" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 557.195442] env[69188]: DEBUG oslo_concurrency.lockutils [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] Acquired lock "singleton_lock" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 557.195650] env[69188]: DEBUG oslo_concurrency.lockutils [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] Releasing lock "singleton_lock" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 557.195957] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] Full set of CONF: {{(pid=69188) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/eventlet/service.py:357}} [ 557.196178] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] ******************************************************************************** {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2804}} [ 557.196296] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] Configuration options gathered from: {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2805}} [ 557.196528] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini', '--config-file', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2806}} [ 557.196700] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2807}} [ 557.196814] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] ================================================================================ {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2809}} [ 557.196988] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] agent_down_time = 75 {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 557.197144] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] allow_automatic_dhcp_failover = True {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 557.197284] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] allow_bulk = True {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 557.197430] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] api_extensions_path = {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 557.197573] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] api_paste_config = api-paste.ini {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 557.197716] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] auth_strategy = keystone {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 557.197828] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] backdoor_port = None {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 557.197933] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] backdoor_socket = None {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 557.198085] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] backlog = 4096 {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 557.198229] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] base_mac = fa:16:3e:00:00:00 {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 557.198388] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] bind_host = 0.0.0.0 {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 557.198533] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] bind_port = 9696 {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 557.198674] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] client_socket_timeout = 900 {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 557.198816] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] config_dir = [] {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 557.198930] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 557.199082] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] config_source = [] {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 557.199227] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] control_exchange = neutron {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 557.199373] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] core_plugin = ml2 {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 557.199519] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] debug = True {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 557.199662] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] default_availability_zones = [] {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 557.199873] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 557.200026] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] dhcp_agent_notification = True {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 557.200171] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] dhcp_agents_per_network = 1 {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 557.200311] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] dhcp_lease_duration = 86400 {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 557.200459] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] dhcp_load_type = networks {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 557.200603] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] dns_domain = openstacklocal {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 557.200744] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] dvr_base_mac = fa:16:3f:00:00:00 {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 557.200880] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] enable_default_route_bfd = False {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 557.201029] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] enable_default_route_ecmp = False {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 557.201172] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] enable_dvr = True {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 557.201311] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] enable_new_agents = True {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 557.201447] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] enable_services_on_agents_with_admin_state_down = False {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 557.201586] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] enable_signals = True {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 557.201724] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] enable_traditional_dhcp = True {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 557.201857] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] external_dns_driver = None {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 557.201992] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] filter_validation = True {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 557.202214] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] global_physnet_mtu = 8950 {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 557.202298] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] graceful_shutdown_timeout = 60 {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 557.202473] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] host = cpu-1 {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 557.202766] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] host_dvr_for_dhcp = True {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 557.202952] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] http_retries = 3 {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 557.203107] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] instance_format = [instance: %(uuid)s] {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 557.203254] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 557.203553] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] ipam_driver = internal {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 557.203553] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] ipv6_pd_enabled = False {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 557.203717] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] l3_ha = False {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 557.203840] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] l3_ha_net_cidr = 169.254.192.0/18 {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 557.203995] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] l3_ha_network_physical_name = {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 557.204113] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] l3_ha_network_type = {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 557.204254] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] log_color = False {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 557.204400] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] log_config_append = None {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 557.204566] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 557.204699] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] log_dir = None {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 557.204841] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] log_file = None {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 557.204990] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] log_options = True {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 557.205095] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] log_rotate_interval = 1 {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 557.205237] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] log_rotate_interval_type = days {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 557.205383] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] log_rotation_type = none {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 557.205496] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 557.205605] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 557.205767] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 557.205915] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 557.206036] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 557.206181] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] max_dns_nameservers = 5 {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 557.206321] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] max_header_line = 16384 {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 557.206461] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] max_l3_agents_per_router = 3 {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 557.206600] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] max_logfile_count = 30 {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 557.206738] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] max_logfile_size_mb = 200 {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 557.206875] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] max_subnet_host_routes = 20 {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 557.207033] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] my_ip = 10.180.1.21 {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 557.207181] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] my_ipv6 = ::1 {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 557.207322] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] network_auto_schedule = True {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 557.207461] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] network_link_prefix = None {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 557.207606] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] network_scheduler_driver = neutron.scheduler.dhcp_agent_scheduler.WeightScheduler {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 557.207753] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] notify_nova_on_port_data_changes = True {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 557.207896] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] notify_nova_on_port_status_changes = True {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 557.208048] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] pagination_max_limit = -1 {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 557.208284] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] publish_errors = False {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 557.208442] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] rate_limit_burst = 0 {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 557.208593] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] rate_limit_except_level = CRITICAL {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 557.208740] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] rate_limit_interval = 0 {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 557.208880] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] retry_until_window = 30 {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 557.209030] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] router_distributed = False {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 557.209175] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] rpc_resources_processing_step = 20 {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 557.209315] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] rpc_response_max_timeout = 600 {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 557.209458] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] rpc_response_timeout = 60 {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 557.209598] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] send_events_interval = 2 {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 557.209755] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] service_plugins = ['router'] {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 557.209902] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] setproctitle = on {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 557.210047] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] shell_completion = None {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 557.210192] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] state_path = /opt/stack/data/neutron {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 557.210335] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] syslog_log_facility = LOG_USER {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 557.210484] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] tcp_keepidle = 600 {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 557.210626] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] transport_url = **** {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 557.210767] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] use_journal = False {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 557.210900] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] use_json = False {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 557.211043] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] use_ssl = False {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 557.211182] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] use_stderr = False {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 557.211324] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] use_syslog = False {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 557.211459] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] vlan_qinq = False {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 557.211594] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] vlan_transparent = False {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 557.211732] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] watch_log_file = False {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 557.211868] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] wsgi_default_pool_size = 100 {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 557.212008] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] wsgi_keep_alive = True {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 557.212158] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 557.212295] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] wsgi_server_debug = False {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 557.212448] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] oslo_concurrency.disable_process_locking = False {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 557.212600] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 557.212752] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 557.212896] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 557.213049] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] oslo_messaging_metrics.metrics_process_name = {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 557.213195] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 557.213336] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 557.213490] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] profiler.connection_string = messaging:// {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 557.213637] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] profiler.enabled = False {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 557.213787] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] profiler.es_doc_type = notification {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 557.213932] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] profiler.es_scroll_size = 10000 {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 557.214091] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] profiler.es_scroll_time = 2m {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 557.214233] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] profiler.filter_error_trace = False {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 557.214378] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] profiler.hmac_keys = **** {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 557.214523] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] profiler.sentinel_service_name = mymaster {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 557.214701] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] profiler.socket_timeout = 0.1 {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 557.214857] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] profiler.trace_requests = False {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 557.215013] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] profiler.trace_sqlalchemy = False {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 557.215171] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] profiler_jaeger.process_tags = {} {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 557.215312] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] profiler_jaeger.service_name_prefix = None {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 557.215455] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] profiler_otlp.service_name_prefix = None {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 557.215625] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] oslo_policy.enforce_new_defaults = True {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 557.215934] env[69188]: WARNING oslo_config.cfg [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. [ 557.216107] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] oslo_policy.enforce_scope = True {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 557.216260] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] oslo_policy.policy_default_rule = default {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 557.216413] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 557.216562] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] oslo_policy.policy_file = /etc/neutron/policy.json {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 557.216712] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 557.216855] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 557.216994] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 557.217142] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 557.217282] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 557.217431] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] oslo_policy.remote_timeout = 60.0 {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 557.217589] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 557.217743] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] agent.extensions = [] {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 557.217889] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 557.218045] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] service_providers.service_provider = [] {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 557.218198] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] QUOTAS.default_quota = -1 {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 557.218359] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] QUOTAS.quota_driver = neutron.db.quota.driver_nolock.DbQuotaNoLockDriver {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 557.218487] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] QUOTAS.quota_floatingip = 50 {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 557.218629] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] QUOTAS.quota_network = 100 {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 557.218772] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] QUOTAS.quota_port = 500 {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 557.218912] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] QUOTAS.quota_rbac_policy = 10 {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 557.219060] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] QUOTAS.quota_router = 10 {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 557.219200] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] QUOTAS.quota_security_group = 10 {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 557.219339] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] QUOTAS.quota_security_group_rule = 100 {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 557.219476] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] QUOTAS.quota_subnet = 100 {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 557.219613] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] QUOTAS.track_quota_usage = True {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 557.219767] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] privsep.capabilities = [21, 12, 1, 2, 19] {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 557.219967] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] privsep.group = None {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 557.220124] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] privsep.helper_command = None {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 557.220276] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] privsep.logger_name = oslo_privsep.daemon {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 557.220423] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] privsep.thread_pool_size = 8 {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 557.220562] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] privsep.user = None {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 557.220714] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] privsep_dhcp_release.capabilities = [21, 12] {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 557.220855] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] privsep_dhcp_release.group = None {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 557.220992] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] privsep_dhcp_release.helper_command = None {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 557.221147] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] privsep_dhcp_release.logger_name = oslo_privsep.daemon {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 557.221289] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] privsep_dhcp_release.thread_pool_size = 8 {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 557.221426] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] privsep_dhcp_release.user = None {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 557.221573] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] privsep_ovs_vsctl.capabilities = [21, 12] {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 557.221713] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] privsep_ovs_vsctl.group = None {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 557.221850] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] privsep_ovs_vsctl.helper_command = None {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 557.221991] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] privsep_ovs_vsctl.logger_name = oslo_privsep.daemon {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 557.222146] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] privsep_ovs_vsctl.thread_pool_size = 8 {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 557.222284] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] privsep_ovs_vsctl.user = None {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 557.222429] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] privsep_namespace.capabilities = [21] {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 557.222566] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] privsep_namespace.group = None {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 557.222733] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] privsep_namespace.helper_command = None {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 557.222882] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] privsep_namespace.logger_name = oslo_privsep.daemon {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 557.223041] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] privsep_namespace.thread_pool_size = 8 {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 557.223184] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] privsep_namespace.user = None {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 557.223332] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] privsep_conntrack.capabilities = [12] {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 557.223468] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] privsep_conntrack.group = None {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 557.223603] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] privsep_conntrack.helper_command = None {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 557.223747] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] privsep_conntrack.logger_name = oslo_privsep.daemon {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 557.223888] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] privsep_conntrack.thread_pool_size = 8 {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 557.224035] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] privsep_conntrack.user = None {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 557.224204] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] privsep_link.capabilities = [12, 21] {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 557.224320] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] privsep_link.group = None {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 557.224457] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] privsep_link.helper_command = None {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 557.224607] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] privsep_link.logger_name = oslo_privsep.daemon {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 557.224759] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] privsep_link.thread_pool_size = 8 {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 557.224900] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] privsep_link.user = None {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 557.225068] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] AGENT.agent_id = nsxm-l-01a.corp.local {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 557.225222] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] AGENT.agent_prometheus_exporter_port = 8000 {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 557.225364] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] AGENT.continue_on_failed_promotions = False {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 557.225523] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] AGENT.dscp = None {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 557.225639] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] AGENT.dscp_inherit = False {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 557.225807] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] AGENT.force_mp_to_policy = True {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 557.225951] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] AGENT.locking_coordinator_url = None {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 557.226102] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] AGENT.log_agent_heartbeats = False {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 557.226245] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] AGENT.logging_expire = 1 {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 557.226390] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] AGENT.logging_url = unix:///var/run/redis/socket/redis.sock {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 557.226533] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] AGENT.max_sg_tags_per_segment_port = 27 {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 557.226680] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] AGENT.polling_interval = 240 {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 557.226825] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] AGENT.ports_tag_number_decrease_workaround = True {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 557.226972] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] AGENT.quitting_rpc_timeout = 120 {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 557.227130] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] AGENT.report_interval = 30.0 {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 557.227276] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] AGENT.root_helper = sudo /opt/stack/data/venv/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 557.227419] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] AGENT.root_helper_daemon = sudo /opt/stack/data/venv/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 557.227573] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] AGENT.rpc_max_records_per_query = 1000 {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 557.227705] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] AGENT.sync_skew = 60 {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 557.227849] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] AGENT.synchronization_queue_size = 20 {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 557.227993] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] AGENT.use_helper_for_ns_read = True {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 557.228151] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] SECURITYGROUP.enable_ipset = True {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 557.228300] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] SECURITYGROUP.enable_security_group = True {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 557.228445] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] SECURITYGROUP.firewall_driver = nsxv3 {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 557.228591] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] SECURITYGROUP.permitted_ethertypes = [] {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 557.228738] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] experimental.ipv6_pd_enabled = False {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 557.228927] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] ml2.extension_drivers = ['port_security'] {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 557.229077] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] ml2.external_network_type = None {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 557.229231] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] ml2.mechanism_drivers = ['nsxv3', 'openvswitch', 'logger'] {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 557.229380] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] ml2.overlay_ip_version = 4 {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 557.229525] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] ml2.path_mtu = 8950 {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 557.229672] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] ml2.physical_network_mtus = {} {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 557.229824] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] ml2.tenant_network_types = ['vlan'] {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 557.229963] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] ml2.tunnelled_network_rp_name = rp_tunnelled {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 557.230124] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] ml2.type_drivers = ['vlan'] {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 557.230272] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] AGENT_CLI.neutron_port_id = [] {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 557.230413] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] AGENT_CLI.neutron_qos_policy_id = [] {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 557.230553] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] AGENT_CLI.neutron_security_group_id = [] {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 557.230707] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] NSXV3.nsxv3_concurrent_requests = 40 {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 557.230857] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] NSXV3.nsxv3_connection_retry_count = 2 {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 557.231019] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] NSXV3.nsxv3_connection_retry_sleep = 2 {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 557.231170] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] NSXV3.nsxv3_default_policy_infrastructure_rules = True {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 557.231300] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] NSXV3.nsxv3_dfw_connectivity_strategy = NONE {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 557.231442] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] NSXV3.nsxv3_ip_discovery_switching_profile = nsx-default-ip-discovery-vlan-profile {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 557.231635] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] NSXV3.nsxv3_login_hostname = nsxt.osci.c.eu-de-1.cloud.sap {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 557.231785] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] NSXV3.nsxv3_login_password = **** {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 557.231935] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] NSXV3.nsxv3_login_port = 443 {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 557.232091] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] NSXV3.nsxv3_login_user = admin {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 557.232244] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] NSXV3.nsxv3_managed_hosts = [] {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 557.232385] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] NSXV3.nsxv3_max_records_per_query = 200 {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 557.232528] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] NSXV3.nsxv3_operation_retry_count = 3 {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 557.232692] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] NSXV3.nsxv3_operation_retry_sleep = 5 {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 557.232851] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] NSXV3.nsxv3_realization_timeout = 300 {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 557.233010] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] NSXV3.nsxv3_remove_orphan_ports_after = 2.0 {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 557.233164] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] NSXV3.nsxv3_request_timeout = 60 {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 557.233310] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] NSXV3.nsxv3_requests_per_second = 80 {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 557.233454] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] NSXV3.nsxv3_requests_per_second_timeout = 7 {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 557.233599] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] NSXV3.nsxv3_spoof_guard_switching_profile = nsx-default-spoof-guard-vif-profile {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 557.233750] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] NSXV3.nsxv3_suppress_ssl_warnings = True {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 557.233894] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] NSXV3.nsxv3_transport_zone_id_cache_time = 86400 {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 557.234047] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] NSXV3.nsxv3_transport_zone_name = nsx-vlan-transportzone {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 557.234243] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] vsphere.vsphere_login_hostname = vc-l-01a.corp.local {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 557.234395] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] vsphere.vsphere_login_password = VMware1! {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 557.234540] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] vsphere.vsphere_login_username = administrator@vsphere.local {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 557.234710] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] vsphere.vsphere_suppress_ssl_wornings = True {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 557.234866] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] nova.auth_section = None {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 557.235023] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] nova.auth_type = password {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 557.235173] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 557.235316] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] nova.certfile = None {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 557.235459] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] nova.collect_timing = False {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 557.235609] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] nova.endpoint_type = public {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 557.235778] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] nova.insecure = False {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 557.235924] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] nova.keyfile = None {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 557.236085] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] nova.region_name = RegionOne {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 557.236229] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] nova.split_loggers = False {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 557.236367] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] nova.timeout = None {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 557.236510] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] placement.auth_section = None {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 557.236657] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] placement.auth_type = password {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 557.236803] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] placement.cafile = /opt/stack/data/ca-bundle.pem {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 557.236938] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] placement.certfile = None {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 557.237092] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] placement.collect_timing = False {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 557.237242] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] placement.endpoint_type = public {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 557.237377] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] placement.insecure = False {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 557.237508] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] placement.keyfile = None {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 557.237642] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] placement.region_name = None {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 557.237782] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] placement.split_loggers = False {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 557.237912] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] placement.timeout = None {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 557.238062] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] ironic.auth_section = None {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 557.238201] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] ironic.auth_type = None {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 557.238336] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] ironic.cafile = None {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 557.238467] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] ironic.certfile = None {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 557.238606] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] ironic.collect_timing = False {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 557.238744] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] ironic.connect_retries = None {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 557.238877] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] ironic.connect_retry_delay = None {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 557.239023] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] ironic.enable_notifications = False {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 557.239152] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] ironic.endpoint_override = None {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 557.239287] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] ironic.insecure = False {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 557.239419] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] ironic.interface = None {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 557.239549] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] ironic.keyfile = None {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 557.239715] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] ironic.max_version = None {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 557.239807] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] ironic.min_version = None {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 557.239940] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] ironic.region_name = None {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 557.240083] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] ironic.retriable_status_codes = None {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 557.240220] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] ironic.service_name = None {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 557.240349] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] ironic.service_type = None {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 557.240488] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] ironic.split_loggers = False {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 557.240624] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] ironic.status_code_retries = None {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 557.240761] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] ironic.status_code_retry_delay = None {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 557.240894] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] ironic.timeout = None {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 557.241036] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] ironic.valid_interfaces = None {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 557.241173] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] ironic.version = None {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 557.241313] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] cli_script.dry_run = False {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 557.241463] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 557.241605] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 557.241748] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 557.241888] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 557.242038] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 557.242180] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 557.242362] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 557.242447] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 557.242591] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 557.242779] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] oslo_messaging_rabbit.hostname = devstack {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 557.242884] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 557.243036] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 557.243186] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 557.243328] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 557.243468] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 557.243613] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] oslo_messaging_rabbit.processname = neutron-nsxv3-agent {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 557.243753] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 557.243891] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 557.244044] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 557.244188] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 557.244327] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 557.244473] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 557.244628] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 557.244784] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 557.244926] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 557.245078] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 557.245219] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 557.245362] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 557.245500] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 557.245645] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 557.245806] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] oslo_messaging_rabbit.ssl = False {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 557.245958] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 557.246115] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 557.246255] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 557.246398] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 557.246540] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] oslo_messaging_rabbit.ssl_version = {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 557.246762] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 557.246864] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] oslo_messaging_notifications.driver = [] {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 557.247041] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] oslo_messaging_notifications.retry = -1 {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 557.247188] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 557.247337] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] oslo_messaging_notifications.transport_url = **** {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 557.247447] env[69188]: DEBUG oslo_service.backend.eventlet.service [None req-7b5db8db-d2c5-4df0-a4ad-51afae458ebd None None] ******************************************************************************** {{(pid=69188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2828}} [ 557.248427] env[69188]: DEBUG neutron.agent.securitygroups_rpc [None req-ca0141f8-e0d0-45bb-94d3-6579b85b932c None None] Init firewall settings (driver=nsxv3) {{(pid=69188) init_firewall /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:137}} [ 557.249864] env[69188]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.extensions.firewall [None req-ca0141f8-e0d0-45bb-94d3-6579b85b932c None None] Initializing NSXv3SecurityGroupsDriver dummy driver. {{(pid=69188) __init__ /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/extensions/firewall.py:16}} [ 557.250115] env[69188]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-ca0141f8-e0d0-45bb-94d3-6579b85b932c None None] RPC agent_id: nsxm-l-01a.corp.local [ 557.252301] env[69188]: DEBUG dogpile.cache.region [None req-ca0141f8-e0d0-45bb-94d3-6579b85b932c None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 557.252425] env[69188]: DEBUG dogpile.lock [None req-ca0141f8-e0d0-45bb-94d3-6579b85b932c None None] NeedRegenerationException {{(pid=69188) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 557.252526] env[69188]: DEBUG dogpile.lock [None req-ca0141f8-e0d0-45bb-94d3-6579b85b932c None None] no value, waiting for create lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 557.252620] env[69188]: DEBUG dogpile.lock [None req-ca0141f8-e0d0-45bb-94d3-6579b85b932c None None] value creation lock acquired {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 557.252720] env[69188]: DEBUG dogpile.cache.region [None req-ca0141f8-e0d0-45bb-94d3-6579b85b932c None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 557.252817] env[69188]: DEBUG dogpile.lock [None req-ca0141f8-e0d0-45bb-94d3-6579b85b932c None None] Calling creation function for not-yet-present value {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 557.252924] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca0141f8-e0d0-45bb-94d3-6579b85b932c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 557.293718] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-ca0141f8-e0d0-45bb-94d3-6579b85b932c None None] Session token - acquiring [ 557.295471] env[69188]: DEBUG networking_nsxv3.common.locking [None req-ca0141f8-e0d0-45bb-94d3-6579b85b932c None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [, , , , , , , , , , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 557.295662] env[69188]: DEBUG oslo_concurrency.lockutils [None req-ca0141f8-e0d0-45bb-94d3-6579b85b932c None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 557.295822] env[69188]: DEBUG oslo_concurrency.lockutils [None req-ca0141f8-e0d0-45bb-94d3-6579b85b932c None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 557.296211] env[69188]: DEBUG oslo_concurrency.lockutils [None req-ca0141f8-e0d0-45bb-94d3-6579b85b932c None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 557.306443] env[69188]: DEBUG oslo_concurrency.lockutils [None req-ca0141f8-e0d0-45bb-94d3-6579b85b932c None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 557.579064] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-ca0141f8-e0d0-45bb-94d3-6579b85b932c None None] Session token - acquired, connected to NSX-T 4.1.2.0.0.22589037 [ 557.601572] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca0141f8-e0d0-45bb-94d3-6579b85b932c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 557.601729] env[69188]: DEBUG dogpile.cache.region [None req-ca0141f8-e0d0-45bb-94d3-6579b85b932c None None] Cache value generated in 0.349 seconds for key(s): 'zone-id' {{(pid=69188) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 557.601852] env[69188]: DEBUG dogpile.lock [None req-ca0141f8-e0d0-45bb-94d3-6579b85b932c None None] Released creation lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 557.601972] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca0141f8-e0d0-45bb-94d3-6579b85b932c None None] Activating Policy API Provider. [ 557.602179] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca0141f8-e0d0-45bb-94d3-6579b85b932c None None] Looking for the default Infrastructure Rules. [ 557.664911] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca0141f8-e0d0-45bb-94d3-6579b85b932c None None] Looking for the Default Layer3 Logged Drop Section. [ 557.677443] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-ca0141f8-e0d0-45bb-94d3-6579b85b932c None None] Detected NSX-T (4, 1, 2, 0, 0, 22589037) version. [ 557.677877] env[69188]: DEBUG networking_nsxv3.common.locking [None req-ca0141f8-e0d0-45bb-94d3-6579b85b932c None None] Lock all taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 557.678060] env[69188]: DEBUG oslo_concurrency.lockutils [None req-ca0141f8-e0d0-45bb-94d3-6579b85b932c None None] Acquiring lock "all" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 557.678169] env[69188]: DEBUG oslo_concurrency.lockutils [None req-ca0141f8-e0d0-45bb-94d3-6579b85b932c None None] Acquired lock "all" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 557.678435] env[69188]: DEBUG oslo_concurrency.lockutils [None req-ca0141f8-e0d0-45bb-94d3-6579b85b932c None None] Acquired external semaphore "all" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 557.678752] env[69188]: DEBUG networking_nsxv3.api.rpc [None req-ca0141f8-e0d0-45bb-94d3-6579b85b932c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 558.192954] env[69188]: DEBUG networking_nsxv3.api.rpc [None req-ca0141f8-e0d0-45bb-94d3-6579b85b932c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 558.695968] env[69188]: DEBUG networking_nsxv3.api.rpc [None req-ca0141f8-e0d0-45bb-94d3-6579b85b932c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 559.199346] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-ca0141f8-e0d0-45bb-94d3-6579b85b932c None None] Inventory metadata is going to be refreshed. [ 559.199723] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca0141f8-e0d0-45bb-94d3-6579b85b932c None None] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 559.901521] env[69188]: DEBUG networking_nsxv3.common.locking [None req-ca0141f8-e0d0-45bb-94d3-6579b85b932c None None] Lock Segment taken with stack trace [, , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 559.901903] env[69188]: DEBUG oslo_concurrency.lockutils [None req-ca0141f8-e0d0-45bb-94d3-6579b85b932c None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 559.901903] env[69188]: DEBUG oslo_concurrency.lockutils [None req-ca0141f8-e0d0-45bb-94d3-6579b85b932c None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 559.902186] env[69188]: DEBUG oslo_concurrency.lockutils [None req-ca0141f8-e0d0-45bb-94d3-6579b85b932c None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 559.914145] env[69188]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [None req-ca0141f8-e0d0-45bb-94d3-6579b85b932c None None] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 560.022598] env[69188]: DEBUG oslo_concurrency.lockutils [None req-ca0141f8-e0d0-45bb-94d3-6579b85b932c None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 560.023599] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca0141f8-e0d0-45bb-94d3-6579b85b932c None None] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 560.050197] env[69188]: DEBUG networking_nsxv3.common.locking [None req-ca0141f8-e0d0-45bb-94d3-6579b85b932c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 560.050401] env[69188]: DEBUG oslo_concurrency.lockutils [None req-ca0141f8-e0d0-45bb-94d3-6579b85b932c None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 560.050522] env[69188]: DEBUG oslo_concurrency.lockutils [None req-ca0141f8-e0d0-45bb-94d3-6579b85b932c None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 560.050767] env[69188]: DEBUG oslo_concurrency.lockutils [None req-ca0141f8-e0d0-45bb-94d3-6579b85b932c None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 560.050895] env[69188]: DEBUG oslo_concurrency.lockutils [None req-ca0141f8-e0d0-45bb-94d3-6579b85b932c None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 560.051237] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca0141f8-e0d0-45bb-94d3-6579b85b932c None None] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 560.051395] env[69188]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca0141f8-e0d0-45bb-94d3-6579b85b932c None None] Outdated resources of Type:SegmentPort Are:set() {{(pid=69188) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 560.051516] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca0141f8-e0d0-45bb-94d3-6579b85b932c None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 560.070473] env[69188]: DEBUG networking_nsxv3.common.locking [None req-ca0141f8-e0d0-45bb-94d3-6579b85b932c None None] Lock Security Group (Rules) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 560.070722] env[69188]: DEBUG oslo_concurrency.lockutils [None req-ca0141f8-e0d0-45bb-94d3-6579b85b932c None None] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 560.070837] env[69188]: DEBUG oslo_concurrency.lockutils [None req-ca0141f8-e0d0-45bb-94d3-6579b85b932c None None] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 560.071059] env[69188]: DEBUG oslo_concurrency.lockutils [None req-ca0141f8-e0d0-45bb-94d3-6579b85b932c None None] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 560.071239] env[69188]: DEBUG oslo_concurrency.lockutils [None req-ca0141f8-e0d0-45bb-94d3-6579b85b932c None None] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 560.071385] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca0141f8-e0d0-45bb-94d3-6579b85b932c None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 560.088390] env[69188]: DEBUG networking_nsxv3.common.locking [None req-ca0141f8-e0d0-45bb-94d3-6579b85b932c None None] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 560.088612] env[69188]: DEBUG oslo_concurrency.lockutils [None req-ca0141f8-e0d0-45bb-94d3-6579b85b932c None None] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 560.088731] env[69188]: DEBUG oslo_concurrency.lockutils [None req-ca0141f8-e0d0-45bb-94d3-6579b85b932c None None] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 560.088931] env[69188]: DEBUG oslo_concurrency.lockutils [None req-ca0141f8-e0d0-45bb-94d3-6579b85b932c None None] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 560.089093] env[69188]: DEBUG oslo_concurrency.lockutils [None req-ca0141f8-e0d0-45bb-94d3-6579b85b932c None None] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 560.089236] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca0141f8-e0d0-45bb-94d3-6579b85b932c None None] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 560.107811] env[69188]: DEBUG networking_nsxv3.common.locking [None req-ca0141f8-e0d0-45bb-94d3-6579b85b932c None None] Lock Address Group taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 560.107996] env[69188]: DEBUG oslo_concurrency.lockutils [None req-ca0141f8-e0d0-45bb-94d3-6579b85b932c None None] Acquiring lock "Address Group" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 560.108137] env[69188]: DEBUG oslo_concurrency.lockutils [None req-ca0141f8-e0d0-45bb-94d3-6579b85b932c None None] Acquired lock "Address Group" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 560.108398] env[69188]: DEBUG oslo_concurrency.lockutils [None req-ca0141f8-e0d0-45bb-94d3-6579b85b932c None None] Acquired external semaphore "Address Group" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 560.108543] env[69188]: DEBUG oslo_concurrency.lockutils [None req-ca0141f8-e0d0-45bb-94d3-6579b85b932c None None] Releasing lock "Address Group" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 560.108851] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca0141f8-e0d0-45bb-94d3-6579b85b932c None None] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:0. [ 560.108979] env[69188]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca0141f8-e0d0-45bb-94d3-6579b85b932c None None] Outdated resources of Type:Security Group (Rules) Are:set() {{(pid=69188) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 560.109119] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca0141f8-e0d0-45bb-94d3-6579b85b932c None None] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 560.125609] env[69188]: DEBUG networking_nsxv3.common.locking [None req-ca0141f8-e0d0-45bb-94d3-6579b85b932c None None] Lock Segment QoS taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 560.125883] env[69188]: DEBUG oslo_concurrency.lockutils [None req-ca0141f8-e0d0-45bb-94d3-6579b85b932c None None] Acquiring lock "Segment QoS" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 560.126027] env[69188]: DEBUG oslo_concurrency.lockutils [None req-ca0141f8-e0d0-45bb-94d3-6579b85b932c None None] Acquired lock "Segment QoS" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 560.126216] env[69188]: DEBUG oslo_concurrency.lockutils [None req-ca0141f8-e0d0-45bb-94d3-6579b85b932c None None] Acquired external semaphore "Segment QoS" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 560.126346] env[69188]: DEBUG oslo_concurrency.lockutils [None req-ca0141f8-e0d0-45bb-94d3-6579b85b932c None None] Releasing lock "Segment QoS" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 560.126491] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca0141f8-e0d0-45bb-94d3-6579b85b932c None None] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 560.126624] env[69188]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca0141f8-e0d0-45bb-94d3-6579b85b932c None None] Outdated resources of Type:Segment QoS Are:set() {{(pid=69188) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 560.126693] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca0141f8-e0d0-45bb-94d3-6579b85b932c None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 560.144046] env[69188]: DEBUG networking_nsxv3.common.locking [None req-ca0141f8-e0d0-45bb-94d3-6579b85b932c None None] Lock Security Group (Members) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 560.144225] env[69188]: DEBUG oslo_concurrency.lockutils [None req-ca0141f8-e0d0-45bb-94d3-6579b85b932c None None] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 560.144355] env[69188]: DEBUG oslo_concurrency.lockutils [None req-ca0141f8-e0d0-45bb-94d3-6579b85b932c None None] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 560.144601] env[69188]: DEBUG oslo_concurrency.lockutils [None req-ca0141f8-e0d0-45bb-94d3-6579b85b932c None None] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 560.144762] env[69188]: DEBUG oslo_concurrency.lockutils [None req-ca0141f8-e0d0-45bb-94d3-6579b85b932c None None] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 560.144922] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca0141f8-e0d0-45bb-94d3-6579b85b932c None None] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 560.145041] env[69188]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ca0141f8-e0d0-45bb-94d3-6579b85b932c None None] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=69188) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 560.145147] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-ca0141f8-e0d0-45bb-94d3-6579b85b932c None None] Inventory metadata have been refreshed. [ 560.145248] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-ca0141f8-e0d0-45bb-94d3-6579b85b932c None None] Dryrun:True. Metadata refresh completed. [ 560.145366] env[69188]: DEBUG oslo_concurrency.lockutils [None req-ca0141f8-e0d0-45bb-94d3-6579b85b932c None None] Releasing lock "all" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 560.146979] env[69188]: INFO neutron.agent.agent_extensions_manager [None req-ca0141f8-e0d0-45bb-94d3-6579b85b932c None None] Loaded agent extensions: [] [ 560.147681] env[69188]: DEBUG neutron_lib.callbacks.manager [None req-ca0141f8-e0d0-45bb-94d3-6579b85b932c None None] Publish callbacks [] for NSXv3 Agent (None), after_init {{(pid=69188) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} [ 560.209254] env[69188]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-ca0141f8-e0d0-45bb-94d3-6579b85b932c None None] NSXv3 Agent Agent RPC Daemon Started! [ 560.209568] env[69188]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-ca0141f8-e0d0-45bb-94d3-6579b85b932c None None] NSXv3 Agent Agent loop - iteration:0 started [ 560.209568] env[69188]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-ca0141f8-e0d0-45bb-94d3-6579b85b932c None None] NSXv3 Agent Agent out of sync with plugin! [ 565.148958] env[69188]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 565.148958] env[69188]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 570.150401] env[69188]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 570.150765] env[69188]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 574.044501] env[69188]: INFO networking_nsxv3.common.synchronization [None req-63814c2d-71a6-4f11-b68f-be218ee1cd6b demo admin] Enqueued Resource ID: b4fd7931-5512-400c-b903-a4a308642354 with Priority: HIGHEST for action security_group_rules [ 574.044726] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4fd7931-5512-400c-b903-a4a308642354 with Priority: HIGHEST for action security_group_rules [ 574.045314] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b4fd7931-5512-400c-b903-a4a308642354 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 574.045437] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b4fd7931-5512-400c-b903-a4a308642354" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 574.045507] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b4fd7931-5512-400c-b903-a4a308642354" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 574.045836] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b4fd7931-5512-400c-b903-a4a308642354" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 574.045951] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b4fd7931-5512-400c-b903-a4a308642354',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 574.566330] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 574.566599] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 574.566599] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 574.566743] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 574.566871] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 574.566871] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b4fd7931-5512-400c-b903-a4a308642354 already deleted. [ 574.566981] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b4fd7931-5512-400c-b903-a4a308642354" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 579.045916] env[69188]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 579.046241] env[69188]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 584.047487] env[69188]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 584.047487] env[69188]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 584.151063] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.151063] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.151063] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.151063] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.151063] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 584.654029] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 585.156711] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 585.659432] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 585.659595] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 586.374612] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.374999] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.374999] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.374999] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.386700] env[69188]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 586.387491] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.388076] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 586.404281] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.404412] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.404486] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.404645] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.404724] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.404825] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 586.404896] env[69188]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=69188) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 586.404966] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 586.422135] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.422316] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.422316] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.422461] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.422576] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.422671] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 586.440254] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.440380] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.440426] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.440579] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.440669] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.440765] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 586.456821] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.456942] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.456984] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.457166] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.457258] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.457361] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:0. [ 586.457447] env[69188]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:set() {{(pid=69188) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 586.457551] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 586.472526] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.472661] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.472704] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.472863] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.472941] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.473047] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 586.473119] env[69188]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=69188) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 586.473193] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 586.488951] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.489095] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.489140] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.489286] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.489380] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.489481] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 586.489552] env[69188]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=69188) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 586.489616] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 586.489684] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 586.489756] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Rules [ 586.489818] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Members [ 586.489877] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:QoS [ 586.490139] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Items outdated since last Agent sanitize:0 [ 586.490205] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Sanitizing provider based on age cycles [ 586.490273] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 586.506041] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.506170] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.506238] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.506398] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.506490] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.506590] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 586.521485] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.521604] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.521658] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.521808] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.521898] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.533759] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.049110] env[69188]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 589.049412] env[69188]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 594.050108] env[69188]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 594.050539] env[69188]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 597.559713] env[69188]: INFO networking_nsxv3.common.synchronization [None req-a94403c1-51ff-45ed-a526-47058153fa88 None None] Enqueued Resource ID: 5d81a3e0-71cd-4542-bc98-51d9734db712 with Priority: HIGHEST for action port [ 597.560008] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5d81a3e0-71cd-4542-bc98-51d9734db712 with Priority: HIGHEST for action port [ 597.560562] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-5d81a3e0-71cd-4542-bc98-51d9734db712 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.560685] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5d81a3e0-71cd-4542-bc98-51d9734db712" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.563826] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5d81a3e0-71cd-4542-bc98-51d9734db712" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.563826] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5d81a3e0-71cd-4542-bc98-51d9734db712" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.563826] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5d81a3e0-71cd-4542-bc98-51d9734db712',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 598.063442] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5d81a3e0-71cd-4542-bc98-51d9734db712 [ 598.063717] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.063878] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.063967] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.064225] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.064387] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.064474] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5d81a3e0-71cd-4542-bc98-51d9734db712 already deleted. [ 598.064603] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5d81a3e0-71cd-4542-bc98-51d9734db712" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.372067] env[69188]: INFO networking_nsxv3.common.synchronization [None req-469f6db1-74e7-41ac-a668-fbbde7ab2d82 None None] Enqueued Resource ID: 3ce09eb6-c705-43ee-b73c-a3eefa3e4c0f with Priority: HIGHEST for action port [ 599.372542] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3ce09eb6-c705-43ee-b73c-a3eefa3e4c0f with Priority: HIGHEST for action port [ 599.372840] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-3ce09eb6-c705-43ee-b73c-a3eefa3e4c0f taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.373086] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3ce09eb6-c705-43ee-b73c-a3eefa3e4c0f" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.374043] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3ce09eb6-c705-43ee-b73c-a3eefa3e4c0f" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.374328] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3ce09eb6-c705-43ee-b73c-a3eefa3e4c0f" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.374423] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3ce09eb6-c705-43ee-b73c-a3eefa3e4c0f',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 599.457425] env[69188]: INFO networking_nsxv3.common.synchronization [None req-5a0ca8f3-538e-4902-a89b-f5caf5bb5e03 None None] Enqueued Resource ID: 32467035-1bed-4f70-acc9-0ac595fef592 with Priority: HIGHEST for action port [ 599.457724] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 32467035-1bed-4f70-acc9-0ac595fef592 with Priority: HIGHEST for action port [ 599.459072] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-32467035-1bed-4f70-acc9-0ac595fef592 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.459317] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-32467035-1bed-4f70-acc9-0ac595fef592" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.459464] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-32467035-1bed-4f70-acc9-0ac595fef592" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.459854] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-32467035-1bed-4f70-acc9-0ac595fef592" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.460061] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('32467035-1bed-4f70-acc9-0ac595fef592',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 599.878898] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3ce09eb6-c705-43ee-b73c-a3eefa3e4c0f [ 599.878898] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.879116] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.879116] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.879323] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.879394] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.879489] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3ce09eb6-c705-43ee-b73c-a3eefa3e4c0f already deleted. [ 599.879581] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3ce09eb6-c705-43ee-b73c-a3eefa3e4c0f" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.962224] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 32467035-1bed-4f70-acc9-0ac595fef592 [ 599.962343] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.962487] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.962570] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.962773] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.962996] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.962996] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:32467035-1bed-4f70-acc9-0ac595fef592 already deleted. [ 599.963108] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-32467035-1bed-4f70-acc9-0ac595fef592" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.329051] env[69188]: INFO networking_nsxv3.common.synchronization [None req-13efa03f-fb3e-4ba5-bca3-5a7576531b94 None None] Enqueued Resource ID: 96a38908-096d-4b91-b03d-3a261d2bc5b5 with Priority: HIGHEST for action port [ 601.329972] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 96a38908-096d-4b91-b03d-3a261d2bc5b5 with Priority: HIGHEST for action port [ 601.329972] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-96a38908-096d-4b91-b03d-3a261d2bc5b5 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.329972] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-96a38908-096d-4b91-b03d-3a261d2bc5b5" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.329972] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-96a38908-096d-4b91-b03d-3a261d2bc5b5" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.330516] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-96a38908-096d-4b91-b03d-3a261d2bc5b5" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.330516] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('96a38908-096d-4b91-b03d-3a261d2bc5b5',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 601.831672] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 96a38908-096d-4b91-b03d-3a261d2bc5b5 [ 601.831914] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.832069] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.832138] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.832352] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.832463] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.832536] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:96a38908-096d-4b91-b03d-3a261d2bc5b5 already deleted. [ 601.832616] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-96a38908-096d-4b91-b03d-3a261d2bc5b5" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.857203] env[69188]: INFO networking_nsxv3.common.synchronization [None req-7a4d0bf6-5c0a-41b3-a7a4-e692e47b7f60 None None] Enqueued Resource ID: 4faf95a0-202c-4f4c-bc99-2fb079c53437 with Priority: HIGHEST for action port [ 603.857203] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4faf95a0-202c-4f4c-bc99-2fb079c53437 with Priority: HIGHEST for action port [ 603.857624] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-4faf95a0-202c-4f4c-bc99-2fb079c53437 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.857775] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4faf95a0-202c-4f4c-bc99-2fb079c53437" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.857814] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4faf95a0-202c-4f4c-bc99-2fb079c53437" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.858257] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4faf95a0-202c-4f4c-bc99-2fb079c53437" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.858257] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4faf95a0-202c-4f4c-bc99-2fb079c53437',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 604.361970] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4faf95a0-202c-4f4c-bc99-2fb079c53437 [ 604.362217] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.362348] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.362450] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.362633] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.362722] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.362818] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4faf95a0-202c-4f4c-bc99-2fb079c53437 already deleted. [ 604.362899] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4faf95a0-202c-4f4c-bc99-2fb079c53437" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.660440] env[69188]: INFO networking_nsxv3.common.synchronization [None req-19741ec8-e2d7-4ea6-b1a9-73d64e694ba8 None None] Enqueued Resource ID: 20901627-bfa4-42c3-b3f6-6e21d2fc6022 with Priority: HIGHEST for action port [ 604.660440] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 20901627-bfa4-42c3-b3f6-6e21d2fc6022 with Priority: HIGHEST for action port [ 604.660440] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-20901627-bfa4-42c3-b3f6-6e21d2fc6022 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.660440] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-20901627-bfa4-42c3-b3f6-6e21d2fc6022" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.660440] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-20901627-bfa4-42c3-b3f6-6e21d2fc6022" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.660440] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-20901627-bfa4-42c3-b3f6-6e21d2fc6022" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.660440] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('20901627-bfa4-42c3-b3f6-6e21d2fc6022',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 605.057674] env[69188]: INFO networking_nsxv3.common.synchronization [None req-a900e86f-e89c-46f6-9b21-4cf9b1293a04 None None] Enqueued Resource ID: 39ec1679-1fdb-4162-b5ff-ff9bf1222ae8 with Priority: HIGHEST for action port [ 605.058301] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 39ec1679-1fdb-4162-b5ff-ff9bf1222ae8 with Priority: HIGHEST for action port [ 605.058553] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-39ec1679-1fdb-4162-b5ff-ff9bf1222ae8 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.058685] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-39ec1679-1fdb-4162-b5ff-ff9bf1222ae8" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.058754] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-39ec1679-1fdb-4162-b5ff-ff9bf1222ae8" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.058994] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-39ec1679-1fdb-4162-b5ff-ff9bf1222ae8" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.059668] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('39ec1679-1fdb-4162-b5ff-ff9bf1222ae8',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 605.163306] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 20901627-bfa4-42c3-b3f6-6e21d2fc6022 [ 605.163547] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.164571] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.165582] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.165582] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.165582] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.165582] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:20901627-bfa4-42c3-b3f6-6e21d2fc6022 already deleted. [ 605.165582] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-20901627-bfa4-42c3-b3f6-6e21d2fc6022" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.358667] env[69188]: INFO networking_nsxv3.common.synchronization [None req-36c9b523-cdca-4823-838b-61859de17588 None None] Enqueued Resource ID: 3ba533e7-3132-4b70-8794-b1f78d65ebc1 with Priority: HIGHEST for action port [ 605.358931] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3ba533e7-3132-4b70-8794-b1f78d65ebc1 with Priority: HIGHEST for action port [ 605.359505] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-3ba533e7-3132-4b70-8794-b1f78d65ebc1 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.360122] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3ba533e7-3132-4b70-8794-b1f78d65ebc1" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.360122] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3ba533e7-3132-4b70-8794-b1f78d65ebc1" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.360122] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3ba533e7-3132-4b70-8794-b1f78d65ebc1" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.366073] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3ba533e7-3132-4b70-8794-b1f78d65ebc1',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 605.561853] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 39ec1679-1fdb-4162-b5ff-ff9bf1222ae8 [ 605.562104] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.562240] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.562307] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.562530] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.562618] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.562722] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:39ec1679-1fdb-4162-b5ff-ff9bf1222ae8 already deleted. [ 605.562800] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-39ec1679-1fdb-4162-b5ff-ff9bf1222ae8" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.868345] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3ba533e7-3132-4b70-8794-b1f78d65ebc1 [ 605.868584] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.868811] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.868811] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.869664] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.869664] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.869664] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3ba533e7-3132-4b70-8794-b1f78d65ebc1 already deleted. [ 605.870414] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3ba533e7-3132-4b70-8794-b1f78d65ebc1" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.997880] env[69188]: INFO networking_nsxv3.common.synchronization [None req-c99d82eb-1812-47f2-a781-20ab6d09cb11 None None] Enqueued Resource ID: 368ad9c3-3114-4555-bca4-9d1d3f7df2ac with Priority: HIGHEST for action port [ 605.997880] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 368ad9c3-3114-4555-bca4-9d1d3f7df2ac with Priority: HIGHEST for action port [ 605.998119] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-368ad9c3-3114-4555-bca4-9d1d3f7df2ac taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.998119] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-368ad9c3-3114-4555-bca4-9d1d3f7df2ac" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.998270] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-368ad9c3-3114-4555-bca4-9d1d3f7df2ac" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.998865] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-368ad9c3-3114-4555-bca4-9d1d3f7df2ac" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.998865] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('368ad9c3-3114-4555-bca4-9d1d3f7df2ac',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 606.500391] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 368ad9c3-3114-4555-bca4-9d1d3f7df2ac [ 606.500778] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.500778] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.500926] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.501026] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.501132] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.501213] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:368ad9c3-3114-4555-bca4-9d1d3f7df2ac already deleted. [ 606.501290] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-368ad9c3-3114-4555-bca4-9d1d3f7df2ac" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.657646] env[69188]: INFO networking_nsxv3.common.synchronization [None req-73af6cdc-8325-481b-a122-ed8051ee30fa None None] Enqueued Resource ID: 6226bd4f-27f5-41dd-8644-89dfe7670134 with Priority: HIGHEST for action port [ 606.658175] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6226bd4f-27f5-41dd-8644-89dfe7670134 with Priority: HIGHEST for action port [ 606.658449] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-6226bd4f-27f5-41dd-8644-89dfe7670134 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.658612] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6226bd4f-27f5-41dd-8644-89dfe7670134" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.658665] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6226bd4f-27f5-41dd-8644-89dfe7670134" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.658974] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6226bd4f-27f5-41dd-8644-89dfe7670134" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.658974] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6226bd4f-27f5-41dd-8644-89dfe7670134',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.067634] env[69188]: INFO networking_nsxv3.common.synchronization [None req-4069a132-3d0c-4c2d-bb04-a45df76d703a None None] Enqueued Resource ID: fb06fc0d-ec74-4269-9034-cc0ffa685f92 with Priority: HIGHEST for action port [ 607.067634] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb06fc0d-ec74-4269-9034-cc0ffa685f92 with Priority: HIGHEST for action port [ 607.067634] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-fb06fc0d-ec74-4269-9034-cc0ffa685f92 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.067634] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fb06fc0d-ec74-4269-9034-cc0ffa685f92" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.067634] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fb06fc0d-ec74-4269-9034-cc0ffa685f92" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.067634] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fb06fc0d-ec74-4269-9034-cc0ffa685f92" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.067634] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fb06fc0d-ec74-4269-9034-cc0ffa685f92',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.165546] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6226bd4f-27f5-41dd-8644-89dfe7670134 [ 607.165546] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.165546] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.165546] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.165546] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.165546] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.165546] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6226bd4f-27f5-41dd-8644-89dfe7670134 already deleted. [ 607.165546] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6226bd4f-27f5-41dd-8644-89dfe7670134" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.572429] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port fb06fc0d-ec74-4269-9034-cc0ffa685f92 [ 607.572697] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.572814] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.572884] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.573127] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.573216] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.573310] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:fb06fc0d-ec74-4269-9034-cc0ffa685f92 already deleted. [ 607.573388] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fb06fc0d-ec74-4269-9034-cc0ffa685f92" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.979578] env[69188]: INFO networking_nsxv3.common.synchronization [None req-ac55866e-f646-4900-8a74-136cff9c0341 None None] Enqueued Resource ID: c44810cf-de88-4e0e-9f9d-173073aa449d with Priority: HIGHEST for action port [ 607.981459] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c44810cf-de88-4e0e-9f9d-173073aa449d with Priority: HIGHEST for action port [ 607.981602] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-c44810cf-de88-4e0e-9f9d-173073aa449d taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.981658] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c44810cf-de88-4e0e-9f9d-173073aa449d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.981727] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c44810cf-de88-4e0e-9f9d-173073aa449d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.981959] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c44810cf-de88-4e0e-9f9d-173073aa449d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.982053] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c44810cf-de88-4e0e-9f9d-173073aa449d',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 608.093596] env[69188]: INFO networking_nsxv3.common.synchronization [None req-0e58000c-ea0a-45bf-862c-ae2d346a4078 None None] Enqueued Resource ID: 4c20d698-8388-4165-9955-09ade3a25f2a with Priority: HIGHEST for action port [ 608.093596] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4c20d698-8388-4165-9955-09ade3a25f2a with Priority: HIGHEST for action port [ 608.093596] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-4c20d698-8388-4165-9955-09ade3a25f2a taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.093596] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4c20d698-8388-4165-9955-09ade3a25f2a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.093596] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4c20d698-8388-4165-9955-09ade3a25f2a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.093809] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4c20d698-8388-4165-9955-09ade3a25f2a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.093840] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4c20d698-8388-4165-9955-09ade3a25f2a',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 608.484784] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c44810cf-de88-4e0e-9f9d-173073aa449d [ 608.485118] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.485118] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.485241] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.485372] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.485461] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.485595] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c44810cf-de88-4e0e-9f9d-173073aa449d already deleted. [ 608.485641] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c44810cf-de88-4e0e-9f9d-173073aa449d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.599688] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4c20d698-8388-4165-9955-09ade3a25f2a [ 608.599688] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.600016] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.600016] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.600334] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.600334] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.600334] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4c20d698-8388-4165-9955-09ade3a25f2a already deleted. [ 608.600456] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4c20d698-8388-4165-9955-09ade3a25f2a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.175242] env[69188]: INFO networking_nsxv3.common.synchronization [None req-ae191792-c46d-4d91-b1bf-8649003f7861 None None] Enqueued Resource ID: 2da594e4-2736-476c-b2f6-1b1d0b98bca5 with Priority: HIGHEST for action port [ 609.175442] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2da594e4-2736-476c-b2f6-1b1d0b98bca5 with Priority: HIGHEST for action port [ 609.176012] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-2da594e4-2736-476c-b2f6-1b1d0b98bca5 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.176142] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2da594e4-2736-476c-b2f6-1b1d0b98bca5" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.176209] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2da594e4-2736-476c-b2f6-1b1d0b98bca5" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.176450] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2da594e4-2736-476c-b2f6-1b1d0b98bca5" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.176531] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2da594e4-2736-476c-b2f6-1b1d0b98bca5',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 609.185576] env[69188]: INFO networking_nsxv3.common.synchronization [None req-252dd6a6-55c5-447a-ba1f-130cc76515c8 None None] Enqueued Resource ID: 5ea5df9b-80ff-46f3-abaa-2fad9a58cb5f with Priority: HIGHEST for action port [ 609.187998] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5ea5df9b-80ff-46f3-abaa-2fad9a58cb5f with Priority: HIGHEST for action port [ 609.188355] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-5ea5df9b-80ff-46f3-abaa-2fad9a58cb5f taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.189223] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5ea5df9b-80ff-46f3-abaa-2fad9a58cb5f" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.189307] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5ea5df9b-80ff-46f3-abaa-2fad9a58cb5f" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.189516] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5ea5df9b-80ff-46f3-abaa-2fad9a58cb5f" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.189598] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5ea5df9b-80ff-46f3-abaa-2fad9a58cb5f',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 609.686822] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2da594e4-2736-476c-b2f6-1b1d0b98bca5 [ 609.687113] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.687213] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.687285] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.687491] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.687586] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.687680] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2da594e4-2736-476c-b2f6-1b1d0b98bca5 already deleted. [ 609.687763] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2da594e4-2736-476c-b2f6-1b1d0b98bca5" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.694317] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5ea5df9b-80ff-46f3-abaa-2fad9a58cb5f [ 609.694520] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.694643] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.694712] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.694905] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.694992] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.695096] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5ea5df9b-80ff-46f3-abaa-2fad9a58cb5f already deleted. [ 609.695178] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5ea5df9b-80ff-46f3-abaa-2fad9a58cb5f" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.552314] env[69188]: INFO networking_nsxv3.common.synchronization [None req-f42e1bb2-dbb1-4c7e-8e14-378afbe4c6c8 None None] Enqueued Resource ID: 42127f80-7532-4370-a63d-2e90a97520a6 with Priority: HIGHEST for action port [ 610.552585] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 42127f80-7532-4370-a63d-2e90a97520a6 with Priority: HIGHEST for action port [ 610.553182] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-42127f80-7532-4370-a63d-2e90a97520a6 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.553311] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-42127f80-7532-4370-a63d-2e90a97520a6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.553399] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-42127f80-7532-4370-a63d-2e90a97520a6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.553661] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-42127f80-7532-4370-a63d-2e90a97520a6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.553749] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('42127f80-7532-4370-a63d-2e90a97520a6',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 610.875173] env[69188]: INFO networking_nsxv3.common.synchronization [req-cbc86d71-7dc6-4d58-baec-ffbe5beb7f16 req-256aa51f-9723-4aa7-997c-0f58b251ab98 tempest-FloatingIPsAssociationNegativeTestJSON-127533384 tempest-FloatingIPsAssociationNegativeTestJSON-127533384-project-member] Enqueued Resource ID: 5ad89469-8ec8-4f86-aa6c-a6f4c7596c0b with Priority: HIGHEST for action security_group_members [ 610.875482] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5ad89469-8ec8-4f86-aa6c-a6f4c7596c0b with Priority: HIGHEST for action security_group_members [ 610.875997] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-5ad89469-8ec8-4f86-aa6c-a6f4c7596c0b taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.876132] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5ad89469-8ec8-4f86-aa6c-a6f4c7596c0b" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.876193] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5ad89469-8ec8-4f86-aa6c-a6f4c7596c0b" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.876436] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5ad89469-8ec8-4f86-aa6c-a6f4c7596c0b" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.876597] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.876695] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.876747] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.878142] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.878142] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.879268] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5ad89469-8ec8-4f86-aa6c-a6f4c7596c0b',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 611.056634] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 42127f80-7532-4370-a63d-2e90a97520a6 [ 611.056634] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.056634] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.056634] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.057089] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.057089] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.057089] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:42127f80-7532-4370-a63d-2e90a97520a6 already deleted. [ 611.057089] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-42127f80-7532-4370-a63d-2e90a97520a6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.382426] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.382635] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.382727] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.385193] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.385193] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.385193] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.385193] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.385193] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.385193] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.385193] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.385193] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5ad89469-8ec8-4f86-aa6c-a6f4c7596c0b already deleted. [ 611.385193] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5ad89469-8ec8-4f86-aa6c-a6f4c7596c0b" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.406624] env[69188]: INFO networking_nsxv3.common.synchronization [None req-4c5f80aa-f657-4316-a595-42f10ab6fa1e None None] Enqueued Resource ID: 0bb48278-115f-4e13-bbab-f3455f0adea0 with Priority: HIGHEST for action port [ 611.407259] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0bb48278-115f-4e13-bbab-f3455f0adea0 with Priority: HIGHEST for action port [ 611.407643] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-0bb48278-115f-4e13-bbab-f3455f0adea0 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.407822] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0bb48278-115f-4e13-bbab-f3455f0adea0" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.408021] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0bb48278-115f-4e13-bbab-f3455f0adea0" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.408305] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0bb48278-115f-4e13-bbab-f3455f0adea0" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.408414] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0bb48278-115f-4e13-bbab-f3455f0adea0',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 611.537692] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock network-988 taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.537995] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "network-988" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.538142] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "network-988" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.538449] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "network-988" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.538718] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.538875] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.538992] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.539367] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.539556] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.539903] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 611.540065] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] NeedRegenerationException {{(pid=69188) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 611.540212] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] no value, waiting for create lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 611.540347] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] value creation lock acquired {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 611.540539] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 611.540910] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Calling creation function for not-yet-present value {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 611.541137] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 611.561110] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 611.562369] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69188) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 611.562603] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Released creation lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 611.562719] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "network-988" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.563052] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock port-b4bbd501-d8d5-4974-bcd6-61b74ab1dfd2 taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.563230] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "port-b4bbd501-d8d5-4974-bcd6-61b74ab1dfd2" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.563695] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "port-b4bbd501-d8d5-4974-bcd6-61b74ab1dfd2" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.563695] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "port-b4bbd501-d8d5-4974-bcd6-61b74ab1dfd2" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.563805] env[69188]: DEBUG networking_nsxv3.api.rpc [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b4bbd501-d8d5-4974-bcd6-61b74ab1dfd2',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 611.760461] env[69188]: INFO networking_nsxv3.common.synchronization [None req-f23a1856-c050-4a5f-a9b0-975fd5970a49 None None] Enqueued Resource ID: 18ba18a0-46d9-4751-8f1c-6b1b199694be with Priority: HIGHEST for action port [ 611.760461] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 18ba18a0-46d9-4751-8f1c-6b1b199694be with Priority: HIGHEST for action port [ 611.761124] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-18ba18a0-46d9-4751-8f1c-6b1b199694be taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.761124] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-18ba18a0-46d9-4751-8f1c-6b1b199694be" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.761124] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-18ba18a0-46d9-4751-8f1c-6b1b199694be" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.762420] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-18ba18a0-46d9-4751-8f1c-6b1b199694be" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.762511] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('18ba18a0-46d9-4751-8f1c-6b1b199694be',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 611.909830] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0bb48278-115f-4e13-bbab-f3455f0adea0 [ 611.910724] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.910992] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.912147] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.912147] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.912147] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.912147] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0bb48278-115f-4e13-bbab-f3455f0adea0 already deleted. [ 611.912147] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0bb48278-115f-4e13-bbab-f3455f0adea0" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.079613] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.079613] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.079613] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.079613] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.079613] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.079613] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Segment Port b4bbd501-d8d5-4974-bcd6-61b74ab1dfd2 not found, creating... [ 612.079613] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.079613] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.079613] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.079613] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.079613] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.080287] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.080287] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.080287] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.080287] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.080287] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.080287] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Resource: SegmentPort with ID: b4bbd501-d8d5-4974-bcd6-61b74ab1dfd2 is going to be created. [ 612.107950] env[69188]: INFO networking_nsxv3.common.synchronization [None req-9804f8bd-abdc-42b6-8e36-354c016805c1 None None] Enqueued Resource ID: f3ba865b-8609-4c76-a73a-0d1337beede5 with Priority: HIGHEST for action port [ 612.109155] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.109336] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.109459] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.109719] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.109942] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.114074] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "port-b4bbd501-d8d5-4974-bcd6-61b74ab1dfd2" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.114822] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3ba865b-8609-4c76-a73a-0d1337beede5 with Priority: HIGHEST for action port [ 612.115591] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-f3ba865b-8609-4c76-a73a-0d1337beede5 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.115713] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f3ba865b-8609-4c76-a73a-0d1337beede5" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.116299] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f3ba865b-8609-4c76-a73a-0d1337beede5" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.116299] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f3ba865b-8609-4c76-a73a-0d1337beede5" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.116299] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f3ba865b-8609-4c76-a73a-0d1337beede5',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 612.267886] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 18ba18a0-46d9-4751-8f1c-6b1b199694be [ 612.269314] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.269314] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.269314] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.269314] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.269314] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.269314] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:18ba18a0-46d9-4751-8f1c-6b1b199694be already deleted. [ 612.269314] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-18ba18a0-46d9-4751-8f1c-6b1b199694be" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.620275] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f3ba865b-8609-4c76-a73a-0d1337beede5 [ 612.621228] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.621228] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.621373] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.621547] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.621610] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.621755] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f3ba865b-8609-4c76-a73a-0d1337beede5 already deleted. [ 612.621755] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f3ba865b-8609-4c76-a73a-0d1337beede5" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.650395] env[69188]: INFO networking_nsxv3.common.synchronization [req-5ec87952-9d62-40dd-8dcc-d6ee2bfab59f req-751bfdfd-235c-4278-b176-72d949189c44 tempest-ImagesNegativeTestJSON-153925992 tempest-ImagesNegativeTestJSON-153925992-project-member] Enqueued Resource ID: 460ab751-c0ea-45e9-bf76-9a767798212b with Priority: HIGHEST for action security_group_members [ 612.650972] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 460ab751-c0ea-45e9-bf76-9a767798212b with Priority: HIGHEST for action security_group_members [ 612.651331] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-460ab751-c0ea-45e9-bf76-9a767798212b taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.652422] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-460ab751-c0ea-45e9-bf76-9a767798212b" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.652422] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-460ab751-c0ea-45e9-bf76-9a767798212b" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.652422] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-460ab751-c0ea-45e9-bf76-9a767798212b" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.652422] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.652422] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.652422] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.652921] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.653813] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.653813] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('460ab751-c0ea-45e9-bf76-9a767798212b',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 613.157374] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.157661] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.157661] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.157922] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.157922] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.158096] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.158202] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.158262] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.158418] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.158497] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.158585] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 460ab751-c0ea-45e9-bf76-9a767798212b already deleted. [ 613.158671] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-460ab751-c0ea-45e9-bf76-9a767798212b" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.210189] env[69188]: INFO networking_nsxv3.common.synchronization [None req-c95123bb-5512-4e6c-8513-50e15f004383 None None] Enqueued Resource ID: b7ebd1ab-52f0-4ff5-863b-d242cc5ed514 with Priority: HIGHEST for action port [ 613.210189] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b7ebd1ab-52f0-4ff5-863b-d242cc5ed514 with Priority: HIGHEST for action port [ 613.210189] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-b7ebd1ab-52f0-4ff5-863b-d242cc5ed514 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.210673] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b7ebd1ab-52f0-4ff5-863b-d242cc5ed514" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.210673] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b7ebd1ab-52f0-4ff5-863b-d242cc5ed514" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.210673] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b7ebd1ab-52f0-4ff5-863b-d242cc5ed514" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.210673] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b7ebd1ab-52f0-4ff5-863b-d242cc5ed514',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 613.449552] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock network-664 taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.449784] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "network-664" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.449893] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "network-664" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.450262] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "network-664" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.451638] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.451638] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.451638] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.453501] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.453501] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.453501] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 613.455522] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] NeedRegenerationException {{(pid=69188) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 613.455522] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] no value, waiting for create lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 613.455522] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] value creation lock acquired {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 613.455522] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 613.455522] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Calling creation function for not-yet-present value {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 613.455522] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 613.474663] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 613.475262] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69188) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 613.475262] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Released creation lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 613.475262] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "network-664" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.476066] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock port-eceb6aa4-cf02-4892-a7dc-0b7029e353c8 taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.476066] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "port-eceb6aa4-cf02-4892-a7dc-0b7029e353c8" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.476066] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "port-eceb6aa4-cf02-4892-a7dc-0b7029e353c8" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.476934] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "port-eceb6aa4-cf02-4892-a7dc-0b7029e353c8" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.477236] env[69188]: DEBUG networking_nsxv3.api.rpc [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('eceb6aa4-cf02-4892-a7dc-0b7029e353c8',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 613.702498] env[69188]: INFO networking_nsxv3.common.synchronization [req-cbc86d71-7dc6-4d58-baec-ffbe5beb7f16 req-bc51d0d4-1f16-4bcd-afa4-e7e43dd059be service nova] Enqueued Resource ID: 5ad89469-8ec8-4f86-aa6c-a6f4c7596c0b with Priority: HIGHEST for action security_group_rules [ 613.702677] env[69188]: INFO networking_nsxv3.common.synchronization [req-cbc86d71-7dc6-4d58-baec-ffbe5beb7f16 req-bc51d0d4-1f16-4bcd-afa4-e7e43dd059be service nova] Enqueued Resource ID: 5ad89469-8ec8-4f86-aa6c-a6f4c7596c0b with Priority: HIGHEST for action security_group_members [ 613.702837] env[69188]: INFO networking_nsxv3.common.synchronization [req-cbc86d71-7dc6-4d58-baec-ffbe5beb7f16 req-bc51d0d4-1f16-4bcd-afa4-e7e43dd059be service nova] Enqueued Resource ID: b4bbd501-d8d5-4974-bcd6-61b74ab1dfd2 with Priority: HIGHEST for action port [ 613.703492] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5ad89469-8ec8-4f86-aa6c-a6f4c7596c0b with Priority: HIGHEST for action security_group_rules [ 613.703714] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5ad89469-8ec8-4f86-aa6c-a6f4c7596c0b with Priority: HIGHEST for action security_group_members [ 613.703815] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4bbd501-d8d5-4974-bcd6-61b74ab1dfd2 with Priority: HIGHEST for action port [ 613.707637] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5ad89469-8ec8-4f86-aa6c-a6f4c7596c0b taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.707637] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5ad89469-8ec8-4f86-aa6c-a6f4c7596c0b" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.707637] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5ad89469-8ec8-4f86-aa6c-a6f4c7596c0b" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.707637] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5ad89469-8ec8-4f86-aa6c-a6f4c7596c0b" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.707637] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5ad89469-8ec8-4f86-aa6c-a6f4c7596c0b',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 613.707637] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-5ad89469-8ec8-4f86-aa6c-a6f4c7596c0b taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.707637] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5ad89469-8ec8-4f86-aa6c-a6f4c7596c0b" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.707637] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5ad89469-8ec8-4f86-aa6c-a6f4c7596c0b" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.707637] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5ad89469-8ec8-4f86-aa6c-a6f4c7596c0b" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.707637] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.707637] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.707637] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.707637] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.707637] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.707637] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5ad89469-8ec8-4f86-aa6c-a6f4c7596c0b',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 613.708614] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-b4bbd501-d8d5-4974-bcd6-61b74ab1dfd2 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.708731] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b4bbd501-d8d5-4974-bcd6-61b74ab1dfd2" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.709447] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b4bbd501-d8d5-4974-bcd6-61b74ab1dfd2" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.709447] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b4bbd501-d8d5-4974-bcd6-61b74ab1dfd2" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.709447] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b4bbd501-d8d5-4974-bcd6-61b74ab1dfd2',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 613.714621] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b7ebd1ab-52f0-4ff5-863b-d242cc5ed514 [ 613.714621] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.714621] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.714621] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.714785] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.714853] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.714882] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b7ebd1ab-52f0-4ff5-863b-d242cc5ed514 already deleted. [ 613.715020] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b7ebd1ab-52f0-4ff5-863b-d242cc5ed514" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.986717] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.986717] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.986717] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.986717] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.986717] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.986717] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Segment Port eceb6aa4-cf02-4892-a7dc-0b7029e353c8 not found, creating... [ 613.986717] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.986717] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.986717] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.986717] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.986717] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.987144] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.987144] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.987144] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.987404] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.987471] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.987620] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Resource: SegmentPort with ID: eceb6aa4-cf02-4892-a7dc-0b7029e353c8 is going to be created. [ 614.008576] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.008812] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.008955] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.009268] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.009520] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.009752] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "port-eceb6aa4-cf02-4892-a7dc-0b7029e353c8" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.213737] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-5ad89469-8ec8-4f86-aa6c-a6f4c7596c0b taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.214078] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5ad89469-8ec8-4f86-aa6c-a6f4c7596c0b" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.225321] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5ad89469-8ec8-4f86-aa6c-a6f4c7596c0b',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.226282] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b4bbd501-d8d5-4974-bcd6-61b74ab1dfd2 with status ACTIVE [ 614.226475] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.226651] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.226700] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.226880] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.226963] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.227441] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.227553] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.227802] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.227802] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.229904] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.229904] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.229904] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.229904] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.229904] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.229904] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.229904] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b4bbd501-d8d5-4974-bcd6-61b74ab1dfd2 is going to be updated. [ 614.251108] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.251258] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.251328] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.251549] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.251691] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.251852] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b4bbd501-d8d5-4974-bcd6-61b74ab1dfd2" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.417405] env[69188]: INFO networking_nsxv3.common.synchronization [None req-9346b2a6-df99-42ea-8395-61301d53f8f7 None None] Enqueued Resource ID: 07356c09-a19c-4faa-8520-b7eab7a64f80 with Priority: HIGHEST for action port [ 614.417951] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 07356c09-a19c-4faa-8520-b7eab7a64f80 with Priority: HIGHEST for action port [ 614.418287] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-07356c09-a19c-4faa-8520-b7eab7a64f80 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.418426] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-07356c09-a19c-4faa-8520-b7eab7a64f80" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.418537] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-07356c09-a19c-4faa-8520-b7eab7a64f80" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.422300] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-07356c09-a19c-4faa-8520-b7eab7a64f80" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.422331] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('07356c09-a19c-4faa-8520-b7eab7a64f80',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.731597] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5ad89469-8ec8-4f86-aa6c-a6f4c7596c0b',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.924891] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 07356c09-a19c-4faa-8520-b7eab7a64f80 [ 614.925597] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.927169] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.927169] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.927169] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.927169] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.927169] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:07356c09-a19c-4faa-8520-b7eab7a64f80 already deleted. [ 614.927169] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-07356c09-a19c-4faa-8520-b7eab7a64f80" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.047292] env[69188]: INFO networking_nsxv3.common.synchronization [None req-2657b610-b533-47ed-9e27-69038b747505 None None] Enqueued Resource ID: 9dfaf9d5-093e-4130-aad2-457200aa7591 with Priority: HIGHEST for action port [ 615.047292] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9dfaf9d5-093e-4130-aad2-457200aa7591 with Priority: HIGHEST for action port [ 615.047292] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-9dfaf9d5-093e-4130-aad2-457200aa7591 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.047292] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9dfaf9d5-093e-4130-aad2-457200aa7591" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.049650] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9dfaf9d5-093e-4130-aad2-457200aa7591" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.052730] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9dfaf9d5-093e-4130-aad2-457200aa7591" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.052730] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9dfaf9d5-093e-4130-aad2-457200aa7591',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.058918] env[69188]: INFO networking_nsxv3.common.synchronization [None req-c9d36adf-9c28-4e38-b901-f7b4386e10d8 None None] Enqueued Resource ID: 2b691341-b821-4902-b575-f93499651c4a with Priority: HIGHEST for action port [ 615.058918] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2b691341-b821-4902-b575-f93499651c4a with Priority: HIGHEST for action port [ 615.058918] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-2b691341-b821-4902-b575-f93499651c4a taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.058918] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2b691341-b821-4902-b575-f93499651c4a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.058918] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2b691341-b821-4902-b575-f93499651c4a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.058918] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2b691341-b821-4902-b575-f93499651c4a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.058918] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2b691341-b821-4902-b575-f93499651c4a',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.234484] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.236012] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.236012] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.236012] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.236012] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.236012] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5ad89469-8ec8-4f86-aa6c-a6f4c7596c0b is going to be created. [ 615.269089] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.269089] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.269089] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.269089] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.269089] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.276936] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5ad89469-8ec8-4f86-aa6c-a6f4c7596c0b in Status: UNINITIALIZED for 2s [ 615.555472] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9dfaf9d5-093e-4130-aad2-457200aa7591 [ 615.555768] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.555999] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.555999] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.556195] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.556321] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.556368] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9dfaf9d5-093e-4130-aad2-457200aa7591 already deleted. [ 615.556451] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9dfaf9d5-093e-4130-aad2-457200aa7591" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.560161] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2b691341-b821-4902-b575-f93499651c4a [ 615.560161] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.560161] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.560269] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.560365] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.560823] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.560823] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2b691341-b821-4902-b575-f93499651c4a already deleted. [ 615.560823] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2b691341-b821-4902-b575-f93499651c4a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.701804] env[69188]: INFO networking_nsxv3.common.synchronization [req-5ec87952-9d62-40dd-8dcc-d6ee2bfab59f req-00d38043-bf6e-40c7-841a-ff641ffacc68 service nova] Enqueued Resource ID: 460ab751-c0ea-45e9-bf76-9a767798212b with Priority: HIGHEST for action security_group_rules [ 615.702340] env[69188]: INFO networking_nsxv3.common.synchronization [req-5ec87952-9d62-40dd-8dcc-d6ee2bfab59f req-00d38043-bf6e-40c7-841a-ff641ffacc68 service nova] Enqueued Resource ID: 460ab751-c0ea-45e9-bf76-9a767798212b with Priority: HIGHEST for action security_group_members [ 615.702340] env[69188]: INFO networking_nsxv3.common.synchronization [req-5ec87952-9d62-40dd-8dcc-d6ee2bfab59f req-00d38043-bf6e-40c7-841a-ff641ffacc68 service nova] Enqueued Resource ID: eceb6aa4-cf02-4892-a7dc-0b7029e353c8 with Priority: HIGHEST for action port [ 615.702340] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 460ab751-c0ea-45e9-bf76-9a767798212b with Priority: HIGHEST for action security_group_rules [ 615.702497] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 460ab751-c0ea-45e9-bf76-9a767798212b with Priority: HIGHEST for action security_group_members [ 615.702497] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eceb6aa4-cf02-4892-a7dc-0b7029e353c8 with Priority: HIGHEST for action port [ 615.703669] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-460ab751-c0ea-45e9-bf76-9a767798212b taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.703838] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-460ab751-c0ea-45e9-bf76-9a767798212b" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.704061] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-460ab751-c0ea-45e9-bf76-9a767798212b" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.704296] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-460ab751-c0ea-45e9-bf76-9a767798212b" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.704409] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('460ab751-c0ea-45e9-bf76-9a767798212b',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.707268] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-460ab751-c0ea-45e9-bf76-9a767798212b taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.707396] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-460ab751-c0ea-45e9-bf76-9a767798212b" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.707588] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-460ab751-c0ea-45e9-bf76-9a767798212b" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.707643] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-460ab751-c0ea-45e9-bf76-9a767798212b" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.707839] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.707945] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.708020] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.708172] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.708257] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.708345] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('460ab751-c0ea-45e9-bf76-9a767798212b',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.709272] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-eceb6aa4-cf02-4892-a7dc-0b7029e353c8 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.709487] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-eceb6aa4-cf02-4892-a7dc-0b7029e353c8" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.709487] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-eceb6aa4-cf02-4892-a7dc-0b7029e353c8" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.709811] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-eceb6aa4-cf02-4892-a7dc-0b7029e353c8" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.710131] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('eceb6aa4-cf02-4892-a7dc-0b7029e353c8',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.844052] env[69188]: INFO networking_nsxv3.common.synchronization [None req-93971041-6a65-4181-aad7-93a7bed76f91 tempest-ServersTestJSON-1227074238 tempest-ServersTestJSON-1227074238-project-member] Enqueued Resource ID: 55dcb887-f0db-4969-b757-e829798327eb with Priority: HIGHEST for action security_group_rules [ 615.844989] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55dcb887-f0db-4969-b757-e829798327eb with Priority: HIGHEST for action security_group_rules [ 615.845236] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-55dcb887-f0db-4969-b757-e829798327eb taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.845364] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-55dcb887-f0db-4969-b757-e829798327eb" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.846296] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-55dcb887-f0db-4969-b757-e829798327eb" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.847066] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-55dcb887-f0db-4969-b757-e829798327eb" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.847066] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('55dcb887-f0db-4969-b757-e829798327eb',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 616.101365] env[69188]: INFO networking_nsxv3.common.synchronization [None req-9868a80c-1672-4664-b1b7-3ab9cab678dc tempest-ServersTestJSON-1227074238 tempest-ServersTestJSON-1227074238-project-member] Enqueued Resource ID: 55dcb887-f0db-4969-b757-e829798327eb with Priority: HIGHEST for action security_group_rules [ 616.102233] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55dcb887-f0db-4969-b757-e829798327eb with Priority: HIGHEST for action security_group_rules [ 616.102606] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-55dcb887-f0db-4969-b757-e829798327eb taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.102746] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-55dcb887-f0db-4969-b757-e829798327eb" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.212638] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-460ab751-c0ea-45e9-bf76-9a767798212b taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.212812] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-460ab751-c0ea-45e9-bf76-9a767798212b" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.213097] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('460ab751-c0ea-45e9-bf76-9a767798212b',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 616.214630] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port eceb6aa4-cf02-4892-a7dc-0b7029e353c8 with status ACTIVE [ 616.214630] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.214630] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.214630] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.214970] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.214970] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.215144] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.220034] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.220034] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.220034] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.220034] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.220034] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.220034] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.220034] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.220034] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.220034] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.220034] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: eceb6aa4-cf02-4892-a7dc-0b7029e353c8 is going to be updated. [ 616.240515] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.240796] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.240796] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.241028] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.241200] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.241387] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-eceb6aa4-cf02-4892-a7dc-0b7029e353c8" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.367713] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.373573] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.373573] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.373573] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.373573] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.373573] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 55dcb887-f0db-4969-b757-e829798327eb already deleted. [ 616.373573] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-55dcb887-f0db-4969-b757-e829798327eb" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.373573] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-55dcb887-f0db-4969-b757-e829798327eb" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.373573] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-55dcb887-f0db-4969-b757-e829798327eb" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.373573] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('55dcb887-f0db-4969-b757-e829798327eb',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 616.722419] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('460ab751-c0ea-45e9-bf76-9a767798212b',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 616.891779] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.892185] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.892357] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.892690] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.893180] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.893896] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 55dcb887-f0db-4969-b757-e829798327eb already deleted. [ 616.893896] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-55dcb887-f0db-4969-b757-e829798327eb" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.227135] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.228068] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.230015] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.230015] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.230015] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.230015] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 460ab751-c0ea-45e9-bf76-9a767798212b is going to be created. [ 617.264017] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.264316] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.264316] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.264684] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.265148] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.275744] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 460ab751-c0ea-45e9-bf76-9a767798212b in Status: UNINITIALIZED for 2s [ 617.284807] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5ad89469-8ec8-4f86-aa6c-a6f4c7596c0b in Status: SUCCESS [ 617.285069] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5ad89469-8ec8-4f86-aa6c-a6f4c7596c0b" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.285224] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5ad89469-8ec8-4f86-aa6c-a6f4c7596c0b" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.286113] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5ad89469-8ec8-4f86-aa6c-a6f4c7596c0b" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.286113] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.286113] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.286113] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.286113] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.286113] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.286333] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5ad89469-8ec8-4f86-aa6c-a6f4c7596c0b" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.286333] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5ad89469-8ec8-4f86-aa6c-a6f4c7596c0b',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.788941] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-5ad89469-8ec8-4f86-aa6c-a6f4c7596c0b taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.788941] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5ad89469-8ec8-4f86-aa6c-a6f4c7596c0b" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.788941] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5ad89469-8ec8-4f86-aa6c-a6f4c7596c0b" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.789179] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5ad89469-8ec8-4f86-aa6c-a6f4c7596c0b" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.789351] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.790029] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.790029] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.790029] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.790029] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.790029] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5ad89469-8ec8-4f86-aa6c-a6f4c7596c0b" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.790029] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-5ad89469-8ec8-4f86-aa6c-a6f4c7596c0b taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.790029] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5ad89469-8ec8-4f86-aa6c-a6f4c7596c0b" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.790277] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5ad89469-8ec8-4f86-aa6c-a6f4c7596c0b" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.790277] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5ad89469-8ec8-4f86-aa6c-a6f4c7596c0b" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.790336] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.790409] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.790464] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.790602] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.790673] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.790748] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5ad89469-8ec8-4f86-aa6c-a6f4c7596c0b" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.790834] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5ad89469-8ec8-4f86-aa6c-a6f4c7596c0b',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.805078] env[69188]: INFO networking_nsxv3.common.synchronization [req-aef2bd5b-4006-48a1-9c8a-ccabef5a4308 req-96e35860-662d-4a38-af1d-9c1ca9bd1b85 tempest-DeleteServersAdminTestJSON-1786579670 tempest-DeleteServersAdminTestJSON-1786579670-project-member] Enqueued Resource ID: 8960cdd5-264d-45ae-a581-3531272dfbaa with Priority: HIGHEST for action security_group_members [ 617.805376] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8960cdd5-264d-45ae-a581-3531272dfbaa with Priority: HIGHEST for action security_group_members [ 617.805807] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-8960cdd5-264d-45ae-a581-3531272dfbaa taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.805807] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8960cdd5-264d-45ae-a581-3531272dfbaa" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.805944] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8960cdd5-264d-45ae-a581-3531272dfbaa" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.806738] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8960cdd5-264d-45ae-a581-3531272dfbaa" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.806902] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.807022] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.807104] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.809981] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.809981] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.809981] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8960cdd5-264d-45ae-a581-3531272dfbaa',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.296967] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5ad89469-8ec8-4f86-aa6c-a6f4c7596c0b: rpc.has_security_group_logging(os_id): False [ 618.310508] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.310608] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.310680] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.310922] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.311038] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.311232] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.311334] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.311399] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.311554] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.311632] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.311715] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8960cdd5-264d-45ae-a581-3531272dfbaa already deleted. [ 618.311792] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8960cdd5-264d-45ae-a581-3531272dfbaa" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.312808] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.312925] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.312973] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.313168] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.313248] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.313447] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.313574] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.313648] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.313801] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.313917] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.314328] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.314756] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.314756] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.314756] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.314892] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.315056] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.315163] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.315243] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.315417] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.315493] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.315582] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5ad89469-8ec8-4f86-aa6c-a6f4c7596c0b is going to be created. [ 618.370969] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.371140] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.371183] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.371439] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.371610] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.384162] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5ad89469-8ec8-4f86-aa6c-a6f4c7596c0b in Status: IN_PROGRESS for 2s [ 618.725133] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock network-267 taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.725337] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "network-267" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.725459] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "network-267" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.725870] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "network-267" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.726158] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.726317] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.726429] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.726820] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.726986] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.727207] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 618.727317] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] NeedRegenerationException {{(pid=69188) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 618.727422] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] no value, waiting for create lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 618.727526] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] value creation lock acquired {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 618.727631] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 618.727889] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Calling creation function for not-yet-present value {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 618.728148] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 618.757330] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 618.758259] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Cache value generated in 0.029 seconds for key(s): 'zone-id' {{(pid=69188) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 618.758489] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Released creation lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 618.758718] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "network-267" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.759201] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock port-553e456a-898c-4736-8fe1-f4ea859af889 taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.759581] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "port-553e456a-898c-4736-8fe1-f4ea859af889" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.759723] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "port-553e456a-898c-4736-8fe1-f4ea859af889" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.760097] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "port-553e456a-898c-4736-8fe1-f4ea859af889" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.760297] env[69188]: DEBUG networking_nsxv3.api.rpc [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('553e456a-898c-4736-8fe1-f4ea859af889',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.954631] env[69188]: INFO networking_nsxv3.common.synchronization [None req-041a4843-0d87-42aa-8288-79a5de8dfa6d None None] Enqueued Resource ID: 023d6855-aae7-430b-94c3-7b42c6a4f312 with Priority: HIGHEST for action port [ 618.955636] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 023d6855-aae7-430b-94c3-7b42c6a4f312 with Priority: HIGHEST for action port [ 618.956012] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-023d6855-aae7-430b-94c3-7b42c6a4f312 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.956267] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-023d6855-aae7-430b-94c3-7b42c6a4f312" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.956333] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-023d6855-aae7-430b-94c3-7b42c6a4f312" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.956601] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-023d6855-aae7-430b-94c3-7b42c6a4f312" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.956789] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('023d6855-aae7-430b-94c3-7b42c6a4f312',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 619.103594] env[69188]: INFO networking_nsxv3.common.synchronization [None req-ace5f99b-9488-455b-9ac5-722dc5676c40 None None] Enqueued Resource ID: 50dcc67e-837c-4c8b-a1a3-b9949986bb5d with Priority: HIGHEST for action port [ 619.104613] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 50dcc67e-837c-4c8b-a1a3-b9949986bb5d with Priority: HIGHEST for action port [ 619.104613] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-50dcc67e-837c-4c8b-a1a3-b9949986bb5d taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.104613] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-50dcc67e-837c-4c8b-a1a3-b9949986bb5d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.105126] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-50dcc67e-837c-4c8b-a1a3-b9949986bb5d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.105126] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-50dcc67e-837c-4c8b-a1a3-b9949986bb5d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.105126] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('50dcc67e-837c-4c8b-a1a3-b9949986bb5d',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 619.262919] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.263163] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.263288] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.263638] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.263913] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.264305] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Segment Port 553e456a-898c-4736-8fe1-f4ea859af889 not found, creating... [ 619.264621] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.264890] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.265104] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.265410] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.265812] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.266417] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.266547] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.266745] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.266997] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.267160] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.267425] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Resource: SegmentPort with ID: 553e456a-898c-4736-8fe1-f4ea859af889 is going to be created. [ 619.289648] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.289835] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.289993] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.290318] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.290606] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.293097] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "port-553e456a-898c-4736-8fe1-f4ea859af889" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.293097] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 460ab751-c0ea-45e9-bf76-9a767798212b in Status: SUCCESS [ 619.293097] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-460ab751-c0ea-45e9-bf76-9a767798212b" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.293097] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-460ab751-c0ea-45e9-bf76-9a767798212b" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.293407] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-460ab751-c0ea-45e9-bf76-9a767798212b" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.293443] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.293573] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.293615] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.294156] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.294156] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.294156] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-460ab751-c0ea-45e9-bf76-9a767798212b" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.294156] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('460ab751-c0ea-45e9-bf76-9a767798212b',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 619.461541] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 023d6855-aae7-430b-94c3-7b42c6a4f312 [ 619.462386] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.462386] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.462386] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.462862] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.462862] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.462862] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:023d6855-aae7-430b-94c3-7b42c6a4f312 already deleted. [ 619.463060] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-023d6855-aae7-430b-94c3-7b42c6a4f312" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.613448] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 50dcc67e-837c-4c8b-a1a3-b9949986bb5d [ 619.613820] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.614041] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.614155] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.614963] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.614963] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.614963] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:50dcc67e-837c-4c8b-a1a3-b9949986bb5d already deleted. [ 619.614963] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-50dcc67e-837c-4c8b-a1a3-b9949986bb5d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.796331] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-460ab751-c0ea-45e9-bf76-9a767798212b taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.796539] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-460ab751-c0ea-45e9-bf76-9a767798212b" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.796622] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-460ab751-c0ea-45e9-bf76-9a767798212b" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.796954] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-460ab751-c0ea-45e9-bf76-9a767798212b" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.797159] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.797263] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.797325] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.797822] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.797980] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.798114] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-460ab751-c0ea-45e9-bf76-9a767798212b" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.798277] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-460ab751-c0ea-45e9-bf76-9a767798212b taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.798373] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-460ab751-c0ea-45e9-bf76-9a767798212b" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.798434] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-460ab751-c0ea-45e9-bf76-9a767798212b" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.798721] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-460ab751-c0ea-45e9-bf76-9a767798212b" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.802106] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.802323] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.802369] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.802545] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.802629] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.804535] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-460ab751-c0ea-45e9-bf76-9a767798212b" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.804535] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('460ab751-c0ea-45e9-bf76-9a767798212b',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.083341] env[69188]: INFO networking_nsxv3.common.synchronization [req-f6fdff97-b391-446a-8b27-b75d5111663b req-c8f6f7e7-8b80-44e8-9982-7eb61e052f11 tempest-ServerDiagnosticsNegativeTest-520481446 tempest-ServerDiagnosticsNegativeTest-520481446-project-member] Enqueued Resource ID: e1f5743d-088c-4b6d-9680-d1a339199c95 with Priority: HIGHEST for action security_group_members [ 620.083341] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e1f5743d-088c-4b6d-9680-d1a339199c95 with Priority: HIGHEST for action security_group_members [ 620.083341] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-e1f5743d-088c-4b6d-9680-d1a339199c95 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.083341] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e1f5743d-088c-4b6d-9680-d1a339199c95" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.083341] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e1f5743d-088c-4b6d-9680-d1a339199c95" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.083341] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e1f5743d-088c-4b6d-9680-d1a339199c95" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.083341] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.083341] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.083341] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.083341] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.083341] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.083341] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e1f5743d-088c-4b6d-9680-d1a339199c95',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.306739] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 460ab751-c0ea-45e9-bf76-9a767798212b: rpc.has_security_group_logging(os_id): False [ 620.326124] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.326124] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.326124] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.326124] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.326124] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.326302] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.326355] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.326489] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.326761] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.326761] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.326903] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.326981] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.327147] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.327211] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.327405] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.327462] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.327566] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.327595] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.327857] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.327857] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.328033] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 460ab751-c0ea-45e9-bf76-9a767798212b is going to be created. [ 620.383278] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.383460] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.383632] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.383793] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.383998] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.395369] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 460ab751-c0ea-45e9-bf76-9a767798212b in Status: IN_PROGRESS for 2s [ 620.398165] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5ad89469-8ec8-4f86-aa6c-a6f4c7596c0b in Status: SUCCESS [ 620.398165] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5ad89469-8ec8-4f86-aa6c-a6f4c7596c0b" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.588071] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.588361] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.588361] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.588511] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.588604] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.588798] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.588978] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.588978] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.589117] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.589194] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.589281] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e1f5743d-088c-4b6d-9680-d1a339199c95 already deleted. [ 620.589360] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e1f5743d-088c-4b6d-9680-d1a339199c95" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.765297] env[69188]: INFO networking_nsxv3.common.synchronization [None req-b82c188a-813d-40df-8d12-bdb1d06052a1 tempest-VolumesAssistedSnapshotsTest-1534843512 tempest-VolumesAssistedSnapshotsTest-1534843512-project-member] Enqueued Resource ID: 3cd8cf7d-5793-4464-821e-78828cb956a9 with Priority: HIGHEST for action security_group_rules [ 620.765902] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3cd8cf7d-5793-4464-821e-78828cb956a9 with Priority: HIGHEST for action security_group_rules [ 620.766149] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3cd8cf7d-5793-4464-821e-78828cb956a9 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.766273] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3cd8cf7d-5793-4464-821e-78828cb956a9" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.766323] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3cd8cf7d-5793-4464-821e-78828cb956a9" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.766622] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3cd8cf7d-5793-4464-821e-78828cb956a9" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.766687] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3cd8cf7d-5793-4464-821e-78828cb956a9',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.789146] env[69188]: INFO networking_nsxv3.common.synchronization [req-aef2bd5b-4006-48a1-9c8a-ccabef5a4308 req-2c3ef978-8ef4-4fb7-8ee6-e5de6cb0a8b9 service nova] Enqueued Resource ID: 8960cdd5-264d-45ae-a581-3531272dfbaa with Priority: HIGHEST for action security_group_rules [ 620.789146] env[69188]: INFO networking_nsxv3.common.synchronization [req-aef2bd5b-4006-48a1-9c8a-ccabef5a4308 req-2c3ef978-8ef4-4fb7-8ee6-e5de6cb0a8b9 service nova] Enqueued Resource ID: 8960cdd5-264d-45ae-a581-3531272dfbaa with Priority: HIGHEST for action security_group_members [ 620.789146] env[69188]: INFO networking_nsxv3.common.synchronization [req-aef2bd5b-4006-48a1-9c8a-ccabef5a4308 req-2c3ef978-8ef4-4fb7-8ee6-e5de6cb0a8b9 service nova] Enqueued Resource ID: 553e456a-898c-4736-8fe1-f4ea859af889 with Priority: HIGHEST for action port [ 620.789562] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8960cdd5-264d-45ae-a581-3531272dfbaa with Priority: HIGHEST for action security_group_rules [ 620.789937] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8960cdd5-264d-45ae-a581-3531272dfbaa with Priority: HIGHEST for action security_group_members [ 620.790205] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 553e456a-898c-4736-8fe1-f4ea859af889 with Priority: HIGHEST for action port [ 620.790939] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8960cdd5-264d-45ae-a581-3531272dfbaa taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.795502] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8960cdd5-264d-45ae-a581-3531272dfbaa" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.795701] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8960cdd5-264d-45ae-a581-3531272dfbaa" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.797764] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8960cdd5-264d-45ae-a581-3531272dfbaa" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.797764] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8960cdd5-264d-45ae-a581-3531272dfbaa',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.798365] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-8960cdd5-264d-45ae-a581-3531272dfbaa taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.798516] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8960cdd5-264d-45ae-a581-3531272dfbaa" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.798564] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8960cdd5-264d-45ae-a581-3531272dfbaa" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.798726] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8960cdd5-264d-45ae-a581-3531272dfbaa" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.798877] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.798974] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.801821] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.802031] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.808878] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.808878] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8960cdd5-264d-45ae-a581-3531272dfbaa',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.808878] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-553e456a-898c-4736-8fe1-f4ea859af889 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.808878] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-553e456a-898c-4736-8fe1-f4ea859af889" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.808878] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-553e456a-898c-4736-8fe1-f4ea859af889" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.808878] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-553e456a-898c-4736-8fe1-f4ea859af889" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.808878] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('553e456a-898c-4736-8fe1-f4ea859af889',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.834126] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock network-267 taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.834661] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "network-267" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.834661] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "network-267" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.834771] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "network-267" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.835373] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.835373] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.835373] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.837194] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.837397] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.837620] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 620.837741] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] NeedRegenerationException {{(pid=69188) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 620.837851] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] no value, waiting for create lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 620.837964] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] value creation lock acquired {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 620.838127] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 620.838189] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Calling creation function for not-yet-present value {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 620.838329] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 620.861301] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 620.861301] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69188) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 620.861301] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Released creation lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 620.861301] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "network-267" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.861301] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock port-5c3854ed-f36e-4b8d-9583-b0c609b2426e taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.861301] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "port-5c3854ed-f36e-4b8d-9583-b0c609b2426e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.861301] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "port-5c3854ed-f36e-4b8d-9583-b0c609b2426e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.861301] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "port-5c3854ed-f36e-4b8d-9583-b0c609b2426e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.861301] env[69188]: DEBUG networking_nsxv3.api.rpc [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5c3854ed-f36e-4b8d-9583-b0c609b2426e',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.866843] env[69188]: INFO networking_nsxv3.common.synchronization [None req-84714e28-626d-46ab-a360-2a1f9c948863 tempest-VolumesAssistedSnapshotsTest-1534843512 tempest-VolumesAssistedSnapshotsTest-1534843512-project-member] Enqueued Resource ID: 3cd8cf7d-5793-4464-821e-78828cb956a9 with Priority: HIGHEST for action security_group_rules [ 620.866843] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3cd8cf7d-5793-4464-821e-78828cb956a9 with Priority: HIGHEST for action security_group_rules [ 620.867296] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3cd8cf7d-5793-4464-821e-78828cb956a9 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.867542] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3cd8cf7d-5793-4464-821e-78828cb956a9" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.286182] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.286358] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.286388] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.286658] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.286750] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.286845] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3cd8cf7d-5793-4464-821e-78828cb956a9 already deleted. [ 621.286845] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3cd8cf7d-5793-4464-821e-78828cb956a9" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.287011] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3cd8cf7d-5793-4464-821e-78828cb956a9" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.287175] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3cd8cf7d-5793-4464-821e-78828cb956a9" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.287258] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3cd8cf7d-5793-4464-821e-78828cb956a9',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 621.309751] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8960cdd5-264d-45ae-a581-3531272dfbaa',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 621.311727] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-8960cdd5-264d-45ae-a581-3531272dfbaa taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.312352] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8960cdd5-264d-45ae-a581-3531272dfbaa" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.312352] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 553e456a-898c-4736-8fe1-f4ea859af889 with status ACTIVE [ 621.312352] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.312552] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.312609] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.312862] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.314100] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.314879] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.315050] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.315086] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.315393] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.315393] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.315826] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.315826] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.315826] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.316096] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.316391] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.318053] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 553e456a-898c-4736-8fe1-f4ea859af889 is going to be updated. [ 621.335743] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.335911] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.335964] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.336221] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.336358] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.337563] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-553e456a-898c-4736-8fe1-f4ea859af889" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.365467] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.365467] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.366093] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.366322] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.366846] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.367166] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Segment Port 5c3854ed-f36e-4b8d-9583-b0c609b2426e not found, creating... [ 621.367587] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.367762] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.367881] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.368200] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.368354] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.368666] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.369220] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.369220] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.369410] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.370233] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.370233] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Resource: SegmentPort with ID: 5c3854ed-f36e-4b8d-9583-b0c609b2426e is going to be created. [ 621.409712] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.410153] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.410225] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.410773] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.410773] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.411512] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "port-5c3854ed-f36e-4b8d-9583-b0c609b2426e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.812571] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.812853] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.812853] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.812996] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.813102] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.813198] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3cd8cf7d-5793-4464-821e-78828cb956a9 already deleted. [ 621.813279] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3cd8cf7d-5793-4464-821e-78828cb956a9" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.813484] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8960cdd5-264d-45ae-a581-3531272dfbaa',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.016120] env[69188]: INFO networking_nsxv3.common.synchronization [None req-c8eb77c9-34b1-4d62-8cd9-439d5d4f341f None None] Enqueued Resource ID: d510679e-7b57-4f37-aa5a-3188dbd05c02 with Priority: HIGHEST for action port [ 622.016120] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d510679e-7b57-4f37-aa5a-3188dbd05c02 with Priority: HIGHEST for action port [ 622.016120] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-d510679e-7b57-4f37-aa5a-3188dbd05c02 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.016120] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d510679e-7b57-4f37-aa5a-3188dbd05c02" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.016120] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d510679e-7b57-4f37-aa5a-3188dbd05c02" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.016120] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d510679e-7b57-4f37-aa5a-3188dbd05c02" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.016120] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d510679e-7b57-4f37-aa5a-3188dbd05c02',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.318905] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.319104] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.319178] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.319348] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.319567] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.319567] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8960cdd5-264d-45ae-a581-3531272dfbaa is going to be created. [ 622.342474] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.342474] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.342474] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.343230] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.343230] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.353921] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8960cdd5-264d-45ae-a581-3531272dfbaa in Status: UNINITIALIZED for 2s [ 622.404514] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 460ab751-c0ea-45e9-bf76-9a767798212b in Status: SUCCESS [ 622.404751] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-460ab751-c0ea-45e9-bf76-9a767798212b" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.497184] env[69188]: INFO networking_nsxv3.common.synchronization [req-f6fdff97-b391-446a-8b27-b75d5111663b req-4c1ca2ff-dddf-4529-80c3-bd0f5002d406 service nova] Enqueued Resource ID: e1f5743d-088c-4b6d-9680-d1a339199c95 with Priority: HIGHEST for action security_group_rules [ 622.497184] env[69188]: INFO networking_nsxv3.common.synchronization [req-f6fdff97-b391-446a-8b27-b75d5111663b req-4c1ca2ff-dddf-4529-80c3-bd0f5002d406 service nova] Enqueued Resource ID: e1f5743d-088c-4b6d-9680-d1a339199c95 with Priority: HIGHEST for action security_group_members [ 622.497184] env[69188]: INFO networking_nsxv3.common.synchronization [req-f6fdff97-b391-446a-8b27-b75d5111663b req-4c1ca2ff-dddf-4529-80c3-bd0f5002d406 service nova] Enqueued Resource ID: 5c3854ed-f36e-4b8d-9583-b0c609b2426e with Priority: HIGHEST for action port [ 622.497184] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e1f5743d-088c-4b6d-9680-d1a339199c95 with Priority: HIGHEST for action security_group_rules [ 622.497184] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e1f5743d-088c-4b6d-9680-d1a339199c95 with Priority: HIGHEST for action security_group_members [ 622.497393] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5c3854ed-f36e-4b8d-9583-b0c609b2426e with Priority: HIGHEST for action port [ 622.498407] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e1f5743d-088c-4b6d-9680-d1a339199c95 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.498407] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e1f5743d-088c-4b6d-9680-d1a339199c95" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.498407] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e1f5743d-088c-4b6d-9680-d1a339199c95" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.498597] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e1f5743d-088c-4b6d-9680-d1a339199c95" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.498597] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e1f5743d-088c-4b6d-9680-d1a339199c95',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.500458] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-e1f5743d-088c-4b6d-9680-d1a339199c95 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.500458] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e1f5743d-088c-4b6d-9680-d1a339199c95" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.500458] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e1f5743d-088c-4b6d-9680-d1a339199c95" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.500458] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e1f5743d-088c-4b6d-9680-d1a339199c95" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.500458] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.500458] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.500458] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.500458] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.500458] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.500458] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e1f5743d-088c-4b6d-9680-d1a339199c95',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.506032] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-5c3854ed-f36e-4b8d-9583-b0c609b2426e taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.506032] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5c3854ed-f36e-4b8d-9583-b0c609b2426e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.506032] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5c3854ed-f36e-4b8d-9583-b0c609b2426e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.506032] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5c3854ed-f36e-4b8d-9583-b0c609b2426e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.506277] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5c3854ed-f36e-4b8d-9583-b0c609b2426e',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.517787] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d510679e-7b57-4f37-aa5a-3188dbd05c02 [ 622.517787] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.517787] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.518029] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.518086] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.518179] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.518282] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d510679e-7b57-4f37-aa5a-3188dbd05c02 already deleted. [ 622.518364] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d510679e-7b57-4f37-aa5a-3188dbd05c02" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.008293] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-e1f5743d-088c-4b6d-9680-d1a339199c95 taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.008613] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e1f5743d-088c-4b6d-9680-d1a339199c95" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.008613] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e1f5743d-088c-4b6d-9680-d1a339199c95',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 623.009645] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5c3854ed-f36e-4b8d-9583-b0c609b2426e with status ACTIVE [ 623.009645] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.009794] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.009890] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.010107] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.010198] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.010444] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.010670] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.010670] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.010793] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.010850] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.012052] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.012209] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.012313] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.012918] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.013203] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.013532] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5c3854ed-f36e-4b8d-9583-b0c609b2426e is going to be updated. [ 623.033930] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.034138] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.034235] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.034834] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.034834] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.034940] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5c3854ed-f36e-4b8d-9583-b0c609b2426e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.516680] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e1f5743d-088c-4b6d-9680-d1a339199c95',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 623.673607] env[69188]: INFO networking_nsxv3.common.synchronization [None req-e9788cd1-aa22-4e41-a8c2-54e443c4208b None None] Enqueued Resource ID: 6c51920b-7ecb-4a07-ad0c-511132e6f961 with Priority: HIGHEST for action port [ 623.673939] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6c51920b-7ecb-4a07-ad0c-511132e6f961 with Priority: HIGHEST for action port [ 623.675020] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-6c51920b-7ecb-4a07-ad0c-511132e6f961 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.675209] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6c51920b-7ecb-4a07-ad0c-511132e6f961" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.675885] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6c51920b-7ecb-4a07-ad0c-511132e6f961" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.676136] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6c51920b-7ecb-4a07-ad0c-511132e6f961" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.676303] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6c51920b-7ecb-4a07-ad0c-511132e6f961',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 623.774848] env[69188]: INFO networking_nsxv3.common.synchronization [None req-17ac1700-3099-465e-a97a-f9dfb95dd73e None None] Enqueued Resource ID: 8fbbfc9d-a3fc-4a29-bdb4-b8e8fda1f918 with Priority: HIGHEST for action port [ 623.774848] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8fbbfc9d-a3fc-4a29-bdb4-b8e8fda1f918 with Priority: HIGHEST for action port [ 623.775082] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-8fbbfc9d-a3fc-4a29-bdb4-b8e8fda1f918 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.775082] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8fbbfc9d-a3fc-4a29-bdb4-b8e8fda1f918" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.775193] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8fbbfc9d-a3fc-4a29-bdb4-b8e8fda1f918" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.775363] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8fbbfc9d-a3fc-4a29-bdb4-b8e8fda1f918" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.775447] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8fbbfc9d-a3fc-4a29-bdb4-b8e8fda1f918',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 623.972844] env[69188]: INFO networking_nsxv3.common.synchronization [None req-268add13-47dc-4ee4-a10f-1300f279cfc9 None None] Enqueued Resource ID: 1d055011-3503-4b4e-8a62-c88abb2951f1 with Priority: HIGHEST for action port [ 623.973108] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1d055011-3503-4b4e-8a62-c88abb2951f1 with Priority: HIGHEST for action port [ 623.973881] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-1d055011-3503-4b4e-8a62-c88abb2951f1 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.973881] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1d055011-3503-4b4e-8a62-c88abb2951f1" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.973881] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1d055011-3503-4b4e-8a62-c88abb2951f1" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.975814] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1d055011-3503-4b4e-8a62-c88abb2951f1" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.975814] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1d055011-3503-4b4e-8a62-c88abb2951f1',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 624.020517] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.020775] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.020775] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.021267] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.021267] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.021267] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e1f5743d-088c-4b6d-9680-d1a339199c95 is going to be created. [ 624.047261] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.047261] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.047261] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.047261] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.047261] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.062140] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e1f5743d-088c-4b6d-9680-d1a339199c95 in Status: UNINITIALIZED for 2s [ 624.179789] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6c51920b-7ecb-4a07-ad0c-511132e6f961 [ 624.180131] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.180225] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.180280] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.180485] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.180568] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.180681] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6c51920b-7ecb-4a07-ad0c-511132e6f961 already deleted. [ 624.180762] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6c51920b-7ecb-4a07-ad0c-511132e6f961" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.280849] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8fbbfc9d-a3fc-4a29-bdb4-b8e8fda1f918 [ 624.281184] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.281356] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.281431] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.281719] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.281845] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.281965] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8fbbfc9d-a3fc-4a29-bdb4-b8e8fda1f918 already deleted. [ 624.282073] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8fbbfc9d-a3fc-4a29-bdb4-b8e8fda1f918" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.363185] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8960cdd5-264d-45ae-a581-3531272dfbaa in Status: SUCCESS [ 624.364260] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8960cdd5-264d-45ae-a581-3531272dfbaa" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.364260] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8960cdd5-264d-45ae-a581-3531272dfbaa" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.364260] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8960cdd5-264d-45ae-a581-3531272dfbaa" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.364260] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.364260] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.364260] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.364469] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.364469] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.364521] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8960cdd5-264d-45ae-a581-3531272dfbaa" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.364590] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8960cdd5-264d-45ae-a581-3531272dfbaa',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 624.479066] env[69188]: INFO networking_nsxv3.common.synchronization [req-a3202d2b-cdb8-4635-95ee-c637f8cb6d3a req-a41c131c-9fbf-4127-ac2e-96c47d2d9a7f tempest-ImagesOneServerTestJSON-1309400868 tempest-ImagesOneServerTestJSON-1309400868-project-member] Enqueued Resource ID: 614b9fd7-ab13-4673-ace1-c5f03c5b9acc with Priority: HIGHEST for action security_group_members [ 624.480692] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 614b9fd7-ab13-4673-ace1-c5f03c5b9acc with Priority: HIGHEST for action security_group_members [ 624.480692] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-614b9fd7-ab13-4673-ace1-c5f03c5b9acc taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.480930] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-614b9fd7-ab13-4673-ace1-c5f03c5b9acc" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.480930] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-614b9fd7-ab13-4673-ace1-c5f03c5b9acc" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.481440] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-614b9fd7-ab13-4673-ace1-c5f03c5b9acc" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.481440] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.481440] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.481440] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.481620] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.481977] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.481977] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('614b9fd7-ab13-4673-ace1-c5f03c5b9acc',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 624.483206] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1d055011-3503-4b4e-8a62-c88abb2951f1 [ 624.483382] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.483499] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.483640] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.484216] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.484216] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.484216] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1d055011-3503-4b4e-8a62-c88abb2951f1 already deleted. [ 624.484216] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1d055011-3503-4b4e-8a62-c88abb2951f1" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.867559] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-8960cdd5-264d-45ae-a581-3531272dfbaa taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.867704] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8960cdd5-264d-45ae-a581-3531272dfbaa" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.867789] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8960cdd5-264d-45ae-a581-3531272dfbaa" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.868422] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8960cdd5-264d-45ae-a581-3531272dfbaa" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.868422] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.868422] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.868422] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.868637] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.868637] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.868637] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8960cdd5-264d-45ae-a581-3531272dfbaa" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.868893] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-8960cdd5-264d-45ae-a581-3531272dfbaa taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.868893] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8960cdd5-264d-45ae-a581-3531272dfbaa" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.868893] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8960cdd5-264d-45ae-a581-3531272dfbaa" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.869189] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8960cdd5-264d-45ae-a581-3531272dfbaa" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.869189] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.869309] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.869309] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.869456] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.869538] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.869606] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8960cdd5-264d-45ae-a581-3531272dfbaa" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.869690] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8960cdd5-264d-45ae-a581-3531272dfbaa',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 624.985894] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.986682] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.988105] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.988105] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.988105] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.988105] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.988105] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.988105] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.988429] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.988692] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.988692] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 614b9fd7-ab13-4673-ace1-c5f03c5b9acc already deleted. [ 624.988877] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-614b9fd7-ab13-4673-ace1-c5f03c5b9acc" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.173197] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock network-132 taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.173649] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "network-132" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.173649] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "network-132" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.173808] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "network-132" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.175151] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.178673] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.178673] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.178673] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.178673] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.178673] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 625.178673] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] NeedRegenerationException {{(pid=69188) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 625.178673] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] no value, waiting for create lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 625.178673] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] value creation lock acquired {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 625.178673] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 625.178673] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Calling creation function for not-yet-present value {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 625.178673] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 625.197304] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 625.197304] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69188) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 625.197304] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Released creation lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 625.197304] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "network-132" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.197304] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock port-591602f0-223f-401c-ad0d-934b2eeb6f0d taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.197304] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "port-591602f0-223f-401c-ad0d-934b2eeb6f0d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.197304] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "port-591602f0-223f-401c-ad0d-934b2eeb6f0d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.197304] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "port-591602f0-223f-401c-ad0d-934b2eeb6f0d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.197304] env[69188]: DEBUG networking_nsxv3.api.rpc [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('591602f0-223f-401c-ad0d-934b2eeb6f0d',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 625.236390] env[69188]: INFO networking_nsxv3.common.synchronization [None req-59dae926-4a59-4c9e-91ad-46cba828a9bc tempest-ServersWithSpecificFlavorTestJSON-1359499520 tempest-ServersWithSpecificFlavorTestJSON-1359499520-project-member] Enqueued Resource ID: ec45d27b-caa2-4488-8317-d6595de404b8 with Priority: HIGHEST for action security_group_rules [ 625.237174] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ec45d27b-caa2-4488-8317-d6595de404b8 with Priority: HIGHEST for action security_group_rules [ 625.238413] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ec45d27b-caa2-4488-8317-d6595de404b8 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.238622] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ec45d27b-caa2-4488-8317-d6595de404b8" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.238701] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ec45d27b-caa2-4488-8317-d6595de404b8" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.239021] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ec45d27b-caa2-4488-8317-d6595de404b8" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.239234] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ec45d27b-caa2-4488-8317-d6595de404b8',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 625.360884] env[69188]: INFO networking_nsxv3.common.synchronization [None req-4f98930f-120b-496a-91b7-052243413c69 tempest-ServersWithSpecificFlavorTestJSON-1359499520 tempest-ServersWithSpecificFlavorTestJSON-1359499520-project-member] Enqueued Resource ID: ec45d27b-caa2-4488-8317-d6595de404b8 with Priority: HIGHEST for action security_group_rules [ 625.360884] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ec45d27b-caa2-4488-8317-d6595de404b8 with Priority: HIGHEST for action security_group_rules [ 625.361056] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ec45d27b-caa2-4488-8317-d6595de404b8 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.361219] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ec45d27b-caa2-4488-8317-d6595de404b8" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.372988] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8960cdd5-264d-45ae-a581-3531272dfbaa: rpc.has_security_group_logging(os_id): False [ 625.389899] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.390649] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.390649] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.390649] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.390649] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.390928] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.391183] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.391297] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.391496] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.391651] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.395019] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.395019] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.395019] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.395019] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.395019] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.395019] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.395019] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.395019] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.395019] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.395019] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.395019] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8960cdd5-264d-45ae-a581-3531272dfbaa is going to be created. [ 625.448391] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.448620] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.448620] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.448839] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.449053] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.460540] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8960cdd5-264d-45ae-a581-3531272dfbaa in Status: IN_PROGRESS for 2s [ 625.702664] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.702664] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.702664] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.702664] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.702664] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.702664] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Segment Port 591602f0-223f-401c-ad0d-934b2eeb6f0d not found, creating... [ 625.702664] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.703050] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.703050] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.703142] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.703298] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.707496] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.707706] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.707860] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.708449] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.708637] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.711232] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Resource: SegmentPort with ID: 591602f0-223f-401c-ad0d-934b2eeb6f0d is going to be created. [ 625.734329] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.734607] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.734746] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.735149] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.735433] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.735736] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "port-591602f0-223f-401c-ad0d-934b2eeb6f0d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.762268] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.762438] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.762544] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.762745] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.763153] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.763153] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ec45d27b-caa2-4488-8317-d6595de404b8 already deleted. [ 625.763153] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ec45d27b-caa2-4488-8317-d6595de404b8" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.763296] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ec45d27b-caa2-4488-8317-d6595de404b8" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.763390] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ec45d27b-caa2-4488-8317-d6595de404b8" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.763442] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ec45d27b-caa2-4488-8317-d6595de404b8',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 625.974129] env[69188]: INFO networking_nsxv3.common.synchronization [None req-3b436ceb-c913-495e-9265-ec117ef56453 None None] Enqueued Resource ID: dd9e44d5-d523-4717-b18a-2082456f6335 with Priority: HIGHEST for action port [ 625.974129] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dd9e44d5-d523-4717-b18a-2082456f6335 with Priority: HIGHEST for action port [ 625.974129] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-dd9e44d5-d523-4717-b18a-2082456f6335 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.974129] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dd9e44d5-d523-4717-b18a-2082456f6335" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.974129] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dd9e44d5-d523-4717-b18a-2082456f6335" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.974647] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dd9e44d5-d523-4717-b18a-2082456f6335" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.974821] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dd9e44d5-d523-4717-b18a-2082456f6335',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.072201] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e1f5743d-088c-4b6d-9680-d1a339199c95 in Status: SUCCESS [ 626.072662] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e1f5743d-088c-4b6d-9680-d1a339199c95" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.072662] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e1f5743d-088c-4b6d-9680-d1a339199c95" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.072784] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e1f5743d-088c-4b6d-9680-d1a339199c95" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.073848] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.073966] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.073966] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.074469] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.074469] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.074554] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e1f5743d-088c-4b6d-9680-d1a339199c95" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.074671] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e1f5743d-088c-4b6d-9680-d1a339199c95',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.286029] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.286029] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.286029] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.286029] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.286029] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.286029] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ec45d27b-caa2-4488-8317-d6595de404b8 already deleted. [ 626.286029] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ec45d27b-caa2-4488-8317-d6595de404b8" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.479577] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port dd9e44d5-d523-4717-b18a-2082456f6335 [ 626.480038] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.480038] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.480257] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.480415] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.480466] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.481033] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:dd9e44d5-d523-4717-b18a-2082456f6335 already deleted. [ 626.481033] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dd9e44d5-d523-4717-b18a-2082456f6335" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.578161] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-e1f5743d-088c-4b6d-9680-d1a339199c95 taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.578428] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e1f5743d-088c-4b6d-9680-d1a339199c95" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.578428] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e1f5743d-088c-4b6d-9680-d1a339199c95" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.578816] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e1f5743d-088c-4b6d-9680-d1a339199c95" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.578816] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.578958] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.578958] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.579234] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.579234] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.579348] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e1f5743d-088c-4b6d-9680-d1a339199c95" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.579461] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-e1f5743d-088c-4b6d-9680-d1a339199c95 taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.579554] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e1f5743d-088c-4b6d-9680-d1a339199c95" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.579615] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e1f5743d-088c-4b6d-9680-d1a339199c95" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.579759] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e1f5743d-088c-4b6d-9680-d1a339199c95" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.579953] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.580029] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.580072] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.580296] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.580296] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.580403] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e1f5743d-088c-4b6d-9680-d1a339199c95" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.580432] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e1f5743d-088c-4b6d-9680-d1a339199c95',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 627.000638] env[69188]: INFO networking_nsxv3.common.synchronization [req-a3202d2b-cdb8-4635-95ee-c637f8cb6d3a req-52c1dfdd-5197-4987-b6ea-b78d19a0b630 service nova] Enqueued Resource ID: 614b9fd7-ab13-4673-ace1-c5f03c5b9acc with Priority: HIGHEST for action security_group_rules [ 627.000846] env[69188]: INFO networking_nsxv3.common.synchronization [req-a3202d2b-cdb8-4635-95ee-c637f8cb6d3a req-52c1dfdd-5197-4987-b6ea-b78d19a0b630 service nova] Enqueued Resource ID: 614b9fd7-ab13-4673-ace1-c5f03c5b9acc with Priority: HIGHEST for action security_group_members [ 627.000991] env[69188]: INFO networking_nsxv3.common.synchronization [req-a3202d2b-cdb8-4635-95ee-c637f8cb6d3a req-52c1dfdd-5197-4987-b6ea-b78d19a0b630 service nova] Enqueued Resource ID: 591602f0-223f-401c-ad0d-934b2eeb6f0d with Priority: HIGHEST for action port [ 627.001606] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 614b9fd7-ab13-4673-ace1-c5f03c5b9acc with Priority: HIGHEST for action security_group_rules [ 627.001763] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 614b9fd7-ab13-4673-ace1-c5f03c5b9acc with Priority: HIGHEST for action security_group_members [ 627.001868] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 591602f0-223f-401c-ad0d-934b2eeb6f0d with Priority: HIGHEST for action port [ 627.002257] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-614b9fd7-ab13-4673-ace1-c5f03c5b9acc taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.002360] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-614b9fd7-ab13-4673-ace1-c5f03c5b9acc" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.002396] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-614b9fd7-ab13-4673-ace1-c5f03c5b9acc" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.003824] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-614b9fd7-ab13-4673-ace1-c5f03c5b9acc" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.003824] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('614b9fd7-ab13-4673-ace1-c5f03c5b9acc',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 627.004270] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-614b9fd7-ab13-4673-ace1-c5f03c5b9acc taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.004394] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-614b9fd7-ab13-4673-ace1-c5f03c5b9acc" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.004442] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-614b9fd7-ab13-4673-ace1-c5f03c5b9acc" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.004618] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-614b9fd7-ab13-4673-ace1-c5f03c5b9acc" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.004839] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.005328] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.005328] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.005328] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.005328] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.005328] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('614b9fd7-ab13-4673-ace1-c5f03c5b9acc',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 627.006193] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-591602f0-223f-401c-ad0d-934b2eeb6f0d taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.006193] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-591602f0-223f-401c-ad0d-934b2eeb6f0d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.006459] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-591602f0-223f-401c-ad0d-934b2eeb6f0d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.006459] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-591602f0-223f-401c-ad0d-934b2eeb6f0d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.007022] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('591602f0-223f-401c-ad0d-934b2eeb6f0d',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 627.086459] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e1f5743d-088c-4b6d-9680-d1a339199c95: rpc.has_security_group_logging(os_id): False [ 627.106320] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.110220] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.110220] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.110220] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.110220] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.110661] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.110661] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.110661] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.110812] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.110812] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.111876] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.112271] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.112347] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.112511] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.112592] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.112788] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.112901] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.112947] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.113152] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.113251] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.113347] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e1f5743d-088c-4b6d-9680-d1a339199c95 is going to be created. [ 627.188281] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.188281] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.188281] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.188281] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.188434] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.194386] env[69188]: INFO networking_nsxv3.common.synchronization [req-0939147a-249f-4f9b-b5ae-3852682eeda4 req-da8216ec-f278-469d-abdc-8b9c416a4a11 tempest-ImagesOneServerNegativeTestJSON-1186419322 tempest-ImagesOneServerNegativeTestJSON-1186419322-project-member] Enqueued Resource ID: 9d153fe4-605f-47fe-a33b-9d019b977fa7 with Priority: HIGHEST for action security_group_members [ 627.196767] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9d153fe4-605f-47fe-a33b-9d019b977fa7 with Priority: HIGHEST for action security_group_members [ 627.197989] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-9d153fe4-605f-47fe-a33b-9d019b977fa7 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.198545] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9d153fe4-605f-47fe-a33b-9d019b977fa7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.199350] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9d153fe4-605f-47fe-a33b-9d019b977fa7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.200031] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9d153fe4-605f-47fe-a33b-9d019b977fa7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.200288] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.200469] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.201095] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.201356] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.201835] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.201835] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9d153fe4-605f-47fe-a33b-9d019b977fa7',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 627.212830] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e1f5743d-088c-4b6d-9680-d1a339199c95 in Status: IN_PROGRESS for 2s [ 627.472640] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8960cdd5-264d-45ae-a581-3531272dfbaa in Status: SUCCESS [ 627.473028] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8960cdd5-264d-45ae-a581-3531272dfbaa" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.507983] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-614b9fd7-ab13-4673-ace1-c5f03c5b9acc taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.508165] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-614b9fd7-ab13-4673-ace1-c5f03c5b9acc" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.508541] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('614b9fd7-ab13-4673-ace1-c5f03c5b9acc',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 627.509442] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 591602f0-223f-401c-ad0d-934b2eeb6f0d with status ACTIVE [ 627.509665] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.509842] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.509924] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.510114] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.510269] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.510471] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.510599] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.510693] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.510881] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.510971] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.516027] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.516027] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.516027] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.516027] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.516027] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.516027] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 591602f0-223f-401c-ad0d-934b2eeb6f0d is going to be updated. [ 627.533190] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.533387] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.533447] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.533902] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.534030] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.534203] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-591602f0-223f-401c-ad0d-934b2eeb6f0d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.678881] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock network-791 taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.679360] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "network-791" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.679500] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "network-791" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.679829] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "network-791" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.680626] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.680626] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.680776] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.680891] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.681338] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.681434] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 627.681720] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] NeedRegenerationException {{(pid=69188) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 627.681882] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] no value, waiting for create lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 627.682034] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] value creation lock acquired {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 627.682125] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 627.682231] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Calling creation function for not-yet-present value {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 627.682371] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 627.704740] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.704740] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.704740] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.704740] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.704740] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.704740] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.705325] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.705605] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.708016] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.708016] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.708016] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9d153fe4-605f-47fe-a33b-9d019b977fa7 already deleted. [ 627.708016] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9d153fe4-605f-47fe-a33b-9d019b977fa7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.708016] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 627.708016] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=69188) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 627.708016] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Released creation lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 627.708016] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "network-791" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.708753] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock port-1a203f1b-3850-493a-b175-471235ddb362 taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.709139] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "port-1a203f1b-3850-493a-b175-471235ddb362" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.709413] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "port-1a203f1b-3850-493a-b175-471235ddb362" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.709816] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "port-1a203f1b-3850-493a-b175-471235ddb362" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.710110] env[69188]: DEBUG networking_nsxv3.api.rpc [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1a203f1b-3850-493a-b175-471235ddb362',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 628.016192] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('614b9fd7-ab13-4673-ace1-c5f03c5b9acc',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 628.215030] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.215030] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.215030] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.215030] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.215030] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.215030] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Segment Port 1a203f1b-3850-493a-b175-471235ddb362 not found, creating... [ 628.215030] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.215030] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.215030] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.215030] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.215030] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.216150] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.217359] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.217359] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.217359] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.217359] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.220169] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Resource: SegmentPort with ID: 1a203f1b-3850-493a-b175-471235ddb362 is going to be created. [ 628.238078] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.239138] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.239466] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.239822] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.240237] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.240567] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "port-1a203f1b-3850-493a-b175-471235ddb362" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.353634] env[69188]: INFO networking_nsxv3.common.synchronization [req-73d80cde-e5a4-4b31-a4c9-b063a415e5fa req-056d09f2-d94f-409b-b2c3-bd19dc4c4e65 tempest-SecurityGroupRulesNegativeTestJSON-572819127 tempest-SecurityGroupRulesNegativeTestJSON-572819127-project-member] Enqueued Resource ID: 7e891ce3-16eb-477f-a93e-6188f4f431a3 with Priority: HIGHEST for action security_group_rules [ 628.354194] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e891ce3-16eb-477f-a93e-6188f4f431a3 with Priority: HIGHEST for action security_group_rules [ 628.354495] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7e891ce3-16eb-477f-a93e-6188f4f431a3 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.354622] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7e891ce3-16eb-477f-a93e-6188f4f431a3" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.354691] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7e891ce3-16eb-477f-a93e-6188f4f431a3" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.354937] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7e891ce3-16eb-477f-a93e-6188f4f431a3" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.355105] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7e891ce3-16eb-477f-a93e-6188f4f431a3',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 628.521614] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.521614] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.521614] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.521614] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.521614] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.521614] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 614b9fd7-ab13-4673-ace1-c5f03c5b9acc is going to be created. [ 628.543693] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.543693] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.543693] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.543693] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.543693] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.550558] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 614b9fd7-ab13-4673-ace1-c5f03c5b9acc in Status: UNINITIALIZED for 2s [ 628.880546] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.880749] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.880749] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.880965] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.881087] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.881162] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7e891ce3-16eb-477f-a93e-6188f4f431a3 already deleted. [ 628.881249] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7e891ce3-16eb-477f-a93e-6188f4f431a3" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.128559] env[69188]: INFO networking_nsxv3.common.synchronization [req-3a58f7c8-1cd8-4106-b2c2-17e5129c8d4c req-a2c04564-e695-47af-86eb-5c39b09059d9 tempest-DeleteServersTestJSON-857706435 tempest-DeleteServersTestJSON-857706435-project-member] Enqueued Resource ID: 397559b2-3c5a-424d-b09d-43a25d2abba6 with Priority: HIGHEST for action security_group_members [ 629.129764] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 397559b2-3c5a-424d-b09d-43a25d2abba6 with Priority: HIGHEST for action security_group_members [ 629.129881] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-397559b2-3c5a-424d-b09d-43a25d2abba6 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.130053] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-397559b2-3c5a-424d-b09d-43a25d2abba6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.130277] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-397559b2-3c5a-424d-b09d-43a25d2abba6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.130608] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-397559b2-3c5a-424d-b09d-43a25d2abba6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.130772] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.132311] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.132311] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.132389] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.132504] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.132685] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('397559b2-3c5a-424d-b09d-43a25d2abba6',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 629.226862] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e1f5743d-088c-4b6d-9680-d1a339199c95 in Status: SUCCESS [ 629.227070] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e1f5743d-088c-4b6d-9680-d1a339199c95" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.231029] env[69188]: INFO networking_nsxv3.common.synchronization [req-0939147a-249f-4f9b-b5ae-3852682eeda4 req-0574c2ad-e626-4ecb-8110-ab3030573988 service nova] Enqueued Resource ID: 9d153fe4-605f-47fe-a33b-9d019b977fa7 with Priority: HIGHEST for action security_group_rules [ 629.231321] env[69188]: INFO networking_nsxv3.common.synchronization [req-0939147a-249f-4f9b-b5ae-3852682eeda4 req-0574c2ad-e626-4ecb-8110-ab3030573988 service nova] Enqueued Resource ID: 9d153fe4-605f-47fe-a33b-9d019b977fa7 with Priority: HIGHEST for action security_group_members [ 629.231561] env[69188]: INFO networking_nsxv3.common.synchronization [req-0939147a-249f-4f9b-b5ae-3852682eeda4 req-0574c2ad-e626-4ecb-8110-ab3030573988 service nova] Enqueued Resource ID: 1a203f1b-3850-493a-b175-471235ddb362 with Priority: HIGHEST for action port [ 629.231822] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9d153fe4-605f-47fe-a33b-9d019b977fa7 with Priority: HIGHEST for action security_group_rules [ 629.231974] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9d153fe4-605f-47fe-a33b-9d019b977fa7 with Priority: HIGHEST for action security_group_members [ 629.232099] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1a203f1b-3850-493a-b175-471235ddb362 with Priority: HIGHEST for action port [ 629.232700] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9d153fe4-605f-47fe-a33b-9d019b977fa7 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.232831] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9d153fe4-605f-47fe-a33b-9d019b977fa7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.232917] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9d153fe4-605f-47fe-a33b-9d019b977fa7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.239194] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9d153fe4-605f-47fe-a33b-9d019b977fa7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.239194] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9d153fe4-605f-47fe-a33b-9d019b977fa7',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 629.239194] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-9d153fe4-605f-47fe-a33b-9d019b977fa7 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.239194] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9d153fe4-605f-47fe-a33b-9d019b977fa7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.239194] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9d153fe4-605f-47fe-a33b-9d019b977fa7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.239194] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9d153fe4-605f-47fe-a33b-9d019b977fa7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.239194] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.239194] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.239194] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.239194] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.239194] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.239194] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9d153fe4-605f-47fe-a33b-9d019b977fa7',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 629.239194] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-1a203f1b-3850-493a-b175-471235ddb362 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.240129] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1a203f1b-3850-493a-b175-471235ddb362" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.243397] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1a203f1b-3850-493a-b175-471235ddb362" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.243397] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1a203f1b-3850-493a-b175-471235ddb362" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.243397] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1a203f1b-3850-493a-b175-471235ddb362',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 629.635924] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.637196] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.640027] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.640027] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.640027] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.640027] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.640027] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.640027] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.640027] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.640027] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.640027] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 397559b2-3c5a-424d-b09d-43a25d2abba6 already deleted. [ 629.640027] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-397559b2-3c5a-424d-b09d-43a25d2abba6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.745610] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-9d153fe4-605f-47fe-a33b-9d019b977fa7 taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.746274] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9d153fe4-605f-47fe-a33b-9d019b977fa7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.746274] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9d153fe4-605f-47fe-a33b-9d019b977fa7',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 629.748787] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1a203f1b-3850-493a-b175-471235ddb362 with status ACTIVE [ 629.748787] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.748787] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.748787] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.749389] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.749389] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.749389] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.749389] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.749784] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.749784] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.749784] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.749866] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.749949] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.749997] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.750177] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.750256] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.750338] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1a203f1b-3850-493a-b175-471235ddb362 is going to be updated. [ 629.780310] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.780389] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.780420] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.780849] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.780849] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.781183] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1a203f1b-3850-493a-b175-471235ddb362" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.799197] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock network-449 taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.799197] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "network-449" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.799468] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "network-449" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.799602] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "network-449" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.799962] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.800521] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.800796] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.801180] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.801364] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.801580] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 629.801703] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] NeedRegenerationException {{(pid=69188) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 629.801779] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] no value, waiting for create lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 629.801893] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] value creation lock acquired {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 629.802078] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 629.802226] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Calling creation function for not-yet-present value {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 629.802382] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 629.825194] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 629.825194] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69188) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 629.825194] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Released creation lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 629.825194] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "network-449" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.825194] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock port-b0b02262-168a-44e4-b5fc-e94d77b9e880 taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.825194] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "port-b0b02262-168a-44e4-b5fc-e94d77b9e880" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.825194] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "port-b0b02262-168a-44e4-b5fc-e94d77b9e880" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.825194] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "port-b0b02262-168a-44e4-b5fc-e94d77b9e880" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.825194] env[69188]: DEBUG networking_nsxv3.api.rpc [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b0b02262-168a-44e4-b5fc-e94d77b9e880',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 630.254414] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9d153fe4-605f-47fe-a33b-9d019b977fa7',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 630.332478] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.332768] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.332908] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.333212] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.333377] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.333542] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Segment Port b0b02262-168a-44e4-b5fc-e94d77b9e880 not found, creating... [ 630.333883] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.334075] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.334202] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.334440] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.334575] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.335399] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.336645] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.336868] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.337691] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.337691] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.337691] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Resource: SegmentPort with ID: b0b02262-168a-44e4-b5fc-e94d77b9e880 is going to be created. [ 630.357487] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.357722] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.357830] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.358142] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.358401] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.358632] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "port-b0b02262-168a-44e4-b5fc-e94d77b9e880" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.560103] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 614b9fd7-ab13-4673-ace1-c5f03c5b9acc in Status: SUCCESS [ 630.560226] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-614b9fd7-ab13-4673-ace1-c5f03c5b9acc" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.560393] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-614b9fd7-ab13-4673-ace1-c5f03c5b9acc" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.561090] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-614b9fd7-ab13-4673-ace1-c5f03c5b9acc" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.561333] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.561475] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.561608] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.561748] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.562165] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.562165] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-614b9fd7-ab13-4673-ace1-c5f03c5b9acc" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.562165] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('614b9fd7-ab13-4673-ace1-c5f03c5b9acc',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 630.760783] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.760783] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.760783] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.760783] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.760783] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.760783] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9d153fe4-605f-47fe-a33b-9d019b977fa7 is going to be created. [ 630.784897] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.784897] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.784897] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.784897] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.784897] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.794484] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9d153fe4-605f-47fe-a33b-9d019b977fa7 in Status: UNINITIALIZED for 2s [ 631.065559] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-614b9fd7-ab13-4673-ace1-c5f03c5b9acc taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.065559] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-614b9fd7-ab13-4673-ace1-c5f03c5b9acc" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.065559] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-614b9fd7-ab13-4673-ace1-c5f03c5b9acc" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.065559] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-614b9fd7-ab13-4673-ace1-c5f03c5b9acc" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.065559] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.066216] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.066505] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.066774] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.066864] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.067010] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-614b9fd7-ab13-4673-ace1-c5f03c5b9acc" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.067462] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-614b9fd7-ab13-4673-ace1-c5f03c5b9acc taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.067590] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-614b9fd7-ab13-4673-ace1-c5f03c5b9acc" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.068058] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-614b9fd7-ab13-4673-ace1-c5f03c5b9acc" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.068117] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-614b9fd7-ab13-4673-ace1-c5f03c5b9acc" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.068278] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.068488] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.068611] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.068763] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.068889] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.068976] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-614b9fd7-ab13-4673-ace1-c5f03c5b9acc" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.069138] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('614b9fd7-ab13-4673-ace1-c5f03c5b9acc',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.275466] env[69188]: INFO networking_nsxv3.common.synchronization [req-3a58f7c8-1cd8-4106-b2c2-17e5129c8d4c req-69800ab8-76c5-456d-baf8-5ef804865e4d service nova] Enqueued Resource ID: 397559b2-3c5a-424d-b09d-43a25d2abba6 with Priority: HIGHEST for action security_group_rules [ 631.278594] env[69188]: INFO networking_nsxv3.common.synchronization [req-3a58f7c8-1cd8-4106-b2c2-17e5129c8d4c req-69800ab8-76c5-456d-baf8-5ef804865e4d service nova] Enqueued Resource ID: 397559b2-3c5a-424d-b09d-43a25d2abba6 with Priority: HIGHEST for action security_group_members [ 631.278594] env[69188]: INFO networking_nsxv3.common.synchronization [req-3a58f7c8-1cd8-4106-b2c2-17e5129c8d4c req-69800ab8-76c5-456d-baf8-5ef804865e4d service nova] Enqueued Resource ID: b0b02262-168a-44e4-b5fc-e94d77b9e880 with Priority: HIGHEST for action port [ 631.278594] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 397559b2-3c5a-424d-b09d-43a25d2abba6 with Priority: HIGHEST for action security_group_rules [ 631.278594] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 397559b2-3c5a-424d-b09d-43a25d2abba6 with Priority: HIGHEST for action security_group_members [ 631.278594] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b0b02262-168a-44e4-b5fc-e94d77b9e880 with Priority: HIGHEST for action port [ 631.278594] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-397559b2-3c5a-424d-b09d-43a25d2abba6 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.278594] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-397559b2-3c5a-424d-b09d-43a25d2abba6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.278594] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-397559b2-3c5a-424d-b09d-43a25d2abba6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.278594] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-397559b2-3c5a-424d-b09d-43a25d2abba6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.278594] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('397559b2-3c5a-424d-b09d-43a25d2abba6',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.278594] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-397559b2-3c5a-424d-b09d-43a25d2abba6 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.279361] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-397559b2-3c5a-424d-b09d-43a25d2abba6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.282333] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-397559b2-3c5a-424d-b09d-43a25d2abba6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.282556] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-397559b2-3c5a-424d-b09d-43a25d2abba6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.282722] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.282837] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.282894] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.283144] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.283270] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.284013] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('397559b2-3c5a-424d-b09d-43a25d2abba6',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.285968] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-b0b02262-168a-44e4-b5fc-e94d77b9e880 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.285968] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b0b02262-168a-44e4-b5fc-e94d77b9e880" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.285968] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b0b02262-168a-44e4-b5fc-e94d77b9e880" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.285968] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b0b02262-168a-44e4-b5fc-e94d77b9e880" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.285968] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b0b02262-168a-44e4-b5fc-e94d77b9e880',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.574109] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 614b9fd7-ab13-4673-ace1-c5f03c5b9acc: rpc.has_security_group_logging(os_id): False [ 631.591078] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.591208] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.591246] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.591488] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.591606] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.592406] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.592406] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.592406] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.592406] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.592406] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.592662] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.592706] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.593646] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.593646] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.593646] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.593646] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.593646] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.593646] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.593646] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.593984] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.593984] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 614b9fd7-ab13-4673-ace1-c5f03c5b9acc is going to be created. [ 631.620629] env[69188]: INFO networking_nsxv3.common.synchronization [req-ff90a9c2-76a3-40a4-9528-5ef1185fcedd req-16af073d-fb39-4b02-a8b7-b2da82c077a5 tempest-ServersAdminNegativeTestJSON-68746947 tempest-ServersAdminNegativeTestJSON-68746947-project-member] Enqueued Resource ID: b8569476-f644-46f4-87dc-5a1d19af31a2 with Priority: HIGHEST for action security_group_members [ 631.621343] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8569476-f644-46f4-87dc-5a1d19af31a2 with Priority: HIGHEST for action security_group_members [ 631.621835] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8569476-f644-46f4-87dc-5a1d19af31a2 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.621914] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8569476-f644-46f4-87dc-5a1d19af31a2" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.622015] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8569476-f644-46f4-87dc-5a1d19af31a2" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.622427] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8569476-f644-46f4-87dc-5a1d19af31a2" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.622583] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.622735] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.622824] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.623128] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.623164] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.623599] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b8569476-f644-46f4-87dc-5a1d19af31a2',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.656670] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.656862] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.656954] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.657215] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.657400] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.670052] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 614b9fd7-ab13-4673-ace1-c5f03c5b9acc in Status: IN_PROGRESS for 2s [ 631.789487] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-397559b2-3c5a-424d-b09d-43a25d2abba6 taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.789766] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-397559b2-3c5a-424d-b09d-43a25d2abba6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.789807] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('397559b2-3c5a-424d-b09d-43a25d2abba6',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.790680] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b0b02262-168a-44e4-b5fc-e94d77b9e880 with status ACTIVE [ 631.790959] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.791059] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.791059] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.791325] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.791325] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.791494] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.791674] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.791674] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.791823] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.791859] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.793586] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.793706] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.793785] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.793959] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.794077] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.794173] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b0b02262-168a-44e4-b5fc-e94d77b9e880 is going to be updated. [ 631.815089] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.816256] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.816256] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.816256] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.816256] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.816256] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b0b02262-168a-44e4-b5fc-e94d77b9e880" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.930575] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock network-267 taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.930823] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "network-267" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.930959] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "network-267" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.931297] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "network-267" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.931564] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.931732] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.931885] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.932145] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.932300] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.932514] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 631.932627] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] NeedRegenerationException {{(pid=69188) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 631.932737] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] no value, waiting for create lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 631.932847] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] value creation lock acquired {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 631.932958] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 631.933077] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Calling creation function for not-yet-present value {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 631.933237] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 631.953421] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 631.953635] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69188) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 631.953950] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Released creation lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 631.956044] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "network-267" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.956044] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock port-b1df7b10-b41c-42ea-baab-2c71dd6e0d9a taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.956044] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "port-b1df7b10-b41c-42ea-baab-2c71dd6e0d9a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.956044] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "port-b1df7b10-b41c-42ea-baab-2c71dd6e0d9a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.956044] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "port-b1df7b10-b41c-42ea-baab-2c71dd6e0d9a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.956044] env[69188]: DEBUG networking_nsxv3.api.rpc [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b1df7b10-b41c-42ea-baab-2c71dd6e0d9a',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 632.127797] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.127797] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.127797] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.127797] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.127797] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.127797] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.127797] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.127797] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.127797] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.127797] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.127797] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b8569476-f644-46f4-87dc-5a1d19af31a2 already deleted. [ 632.127797] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8569476-f644-46f4-87dc-5a1d19af31a2" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.161282] env[69188]: INFO networking_nsxv3.common.synchronization [req-d57b1d03-c753-490c-b69a-a7da4f4a109e req-ef97fe3c-0d7b-4295-b0fd-9b2061ec1fac tempest-SecurityGroupRulesNegativeTestJSON-572819127 tempest-SecurityGroupRulesNegativeTestJSON-572819127-project-member] Enqueued Resource ID: 7e891ce3-16eb-477f-a93e-6188f4f431a3 with Priority: HIGHEST for action security_group_rules [ 632.161282] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e891ce3-16eb-477f-a93e-6188f4f431a3 with Priority: HIGHEST for action security_group_rules [ 632.161282] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7e891ce3-16eb-477f-a93e-6188f4f431a3 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.161282] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7e891ce3-16eb-477f-a93e-6188f4f431a3" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.161282] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7e891ce3-16eb-477f-a93e-6188f4f431a3" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.161282] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7e891ce3-16eb-477f-a93e-6188f4f431a3" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.161282] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7e891ce3-16eb-477f-a93e-6188f4f431a3',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 632.296124] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('397559b2-3c5a-424d-b09d-43a25d2abba6',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 632.458161] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.458407] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.458535] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.459360] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.459536] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.459706] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Segment Port b1df7b10-b41c-42ea-baab-2c71dd6e0d9a not found, creating... [ 632.459991] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.460168] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.460376] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.460966] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.460966] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.461167] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.461290] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.461290] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.461500] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.461633] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.461925] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Resource: SegmentPort with ID: b1df7b10-b41c-42ea-baab-2c71dd6e0d9a is going to be created. [ 632.479816] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.480051] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.480851] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.480851] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.480851] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.480851] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "port-b1df7b10-b41c-42ea-baab-2c71dd6e0d9a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.686599] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.686805] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.686915] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.687216] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.687326] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.687545] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7e891ce3-16eb-477f-a93e-6188f4f431a3 already deleted. [ 632.687628] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7e891ce3-16eb-477f-a93e-6188f4f431a3" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.799033] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.799435] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.799435] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.799577] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.799649] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.799760] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 397559b2-3c5a-424d-b09d-43a25d2abba6 is going to be created. [ 632.802989] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9d153fe4-605f-47fe-a33b-9d019b977fa7 in Status: SUCCESS [ 632.803214] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9d153fe4-605f-47fe-a33b-9d019b977fa7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.803385] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9d153fe4-605f-47fe-a33b-9d019b977fa7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.803584] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9d153fe4-605f-47fe-a33b-9d019b977fa7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.803816] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.804112] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.804112] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.804234] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.804282] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.804380] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9d153fe4-605f-47fe-a33b-9d019b977fa7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.804483] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9d153fe4-605f-47fe-a33b-9d019b977fa7',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 632.818900] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.819663] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.819663] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.819663] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.819663] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.828354] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 397559b2-3c5a-424d-b09d-43a25d2abba6 in Status: UNINITIALIZED for 2s [ 633.310449] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-9d153fe4-605f-47fe-a33b-9d019b977fa7 taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.310814] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9d153fe4-605f-47fe-a33b-9d019b977fa7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.310987] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9d153fe4-605f-47fe-a33b-9d019b977fa7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.311403] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9d153fe4-605f-47fe-a33b-9d019b977fa7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.311744] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.311962] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.312163] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.312418] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.312613] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.312789] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9d153fe4-605f-47fe-a33b-9d019b977fa7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.313041] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-9d153fe4-605f-47fe-a33b-9d019b977fa7 taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.313247] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9d153fe4-605f-47fe-a33b-9d019b977fa7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.313390] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9d153fe4-605f-47fe-a33b-9d019b977fa7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.313614] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9d153fe4-605f-47fe-a33b-9d019b977fa7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.313998] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.314699] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.314885] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.315136] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.315310] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.315476] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9d153fe4-605f-47fe-a33b-9d019b977fa7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.315647] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9d153fe4-605f-47fe-a33b-9d019b977fa7',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.318836] env[69188]: INFO networking_nsxv3.common.synchronization [req-ff90a9c2-76a3-40a4-9528-5ef1185fcedd req-a2ae878b-aab0-4d77-85df-21a30f9bbee5 service nova] Enqueued Resource ID: b8569476-f644-46f4-87dc-5a1d19af31a2 with Priority: HIGHEST for action security_group_rules [ 633.318836] env[69188]: INFO networking_nsxv3.common.synchronization [req-ff90a9c2-76a3-40a4-9528-5ef1185fcedd req-a2ae878b-aab0-4d77-85df-21a30f9bbee5 service nova] Enqueued Resource ID: b8569476-f644-46f4-87dc-5a1d19af31a2 with Priority: HIGHEST for action security_group_members [ 633.321824] env[69188]: INFO networking_nsxv3.common.synchronization [req-ff90a9c2-76a3-40a4-9528-5ef1185fcedd req-a2ae878b-aab0-4d77-85df-21a30f9bbee5 service nova] Enqueued Resource ID: b1df7b10-b41c-42ea-baab-2c71dd6e0d9a with Priority: HIGHEST for action port [ 633.322475] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8569476-f644-46f4-87dc-5a1d19af31a2 with Priority: HIGHEST for action security_group_rules [ 633.322775] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8569476-f644-46f4-87dc-5a1d19af31a2 with Priority: HIGHEST for action security_group_members [ 633.323309] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b1df7b10-b41c-42ea-baab-2c71dd6e0d9a with Priority: HIGHEST for action port [ 633.325022] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b8569476-f644-46f4-87dc-5a1d19af31a2 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.325376] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b8569476-f644-46f4-87dc-5a1d19af31a2" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.325523] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b8569476-f644-46f4-87dc-5a1d19af31a2" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.325862] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b8569476-f644-46f4-87dc-5a1d19af31a2" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.326121] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b8569476-f644-46f4-87dc-5a1d19af31a2',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.327248] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8569476-f644-46f4-87dc-5a1d19af31a2 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.331332] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8569476-f644-46f4-87dc-5a1d19af31a2" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.331332] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8569476-f644-46f4-87dc-5a1d19af31a2" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.331332] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8569476-f644-46f4-87dc-5a1d19af31a2" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.331332] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.331332] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.331332] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.331332] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.331332] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.331332] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b8569476-f644-46f4-87dc-5a1d19af31a2',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.331332] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-b1df7b10-b41c-42ea-baab-2c71dd6e0d9a taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.331332] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b1df7b10-b41c-42ea-baab-2c71dd6e0d9a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.331332] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b1df7b10-b41c-42ea-baab-2c71dd6e0d9a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.331332] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b1df7b10-b41c-42ea-baab-2c71dd6e0d9a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.331332] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b1df7b10-b41c-42ea-baab-2c71dd6e0d9a',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.698429] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 614b9fd7-ab13-4673-ace1-c5f03c5b9acc in Status: SUCCESS [ 633.698429] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-614b9fd7-ab13-4673-ace1-c5f03c5b9acc" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.823794] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9d153fe4-605f-47fe-a33b-9d019b977fa7: rpc.has_security_group_logging(os_id): False [ 633.839747] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b8569476-f644-46f4-87dc-5a1d19af31a2',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.839747] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8569476-f644-46f4-87dc-5a1d19af31a2 taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.839747] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8569476-f644-46f4-87dc-5a1d19af31a2" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.841488] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b1df7b10-b41c-42ea-baab-2c71dd6e0d9a with status ACTIVE [ 633.841882] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.842157] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.842339] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.842640] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.845021] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.845021] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.845021] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.845021] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.845021] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.845021] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.845021] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.845021] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.845021] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.845021] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.845021] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.845021] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b1df7b10-b41c-42ea-baab-2c71dd6e0d9a is going to be updated. [ 633.855068] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.855068] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.855068] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.855068] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.855068] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.855068] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.855068] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.855068] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.855068] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.855068] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.855068] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.855068] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.855068] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.855068] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.855068] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.855640] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.855640] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.855640] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.855640] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.855640] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.855640] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9d153fe4-605f-47fe-a33b-9d019b977fa7 is going to be created. [ 633.873482] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.873482] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.873482] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.873482] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.873482] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.873482] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b1df7b10-b41c-42ea-baab-2c71dd6e0d9a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.925269] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.925269] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.925269] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.925269] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.925269] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.945496] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9d153fe4-605f-47fe-a33b-9d019b977fa7 in Status: IN_PROGRESS for 2s [ 634.340733] env[69188]: INFO networking_nsxv3.common.synchronization [req-f81a76eb-36c9-469f-9a50-3fc33331d375 req-41e15fce-c470-40d0-9cf7-0c961c7e4387 tempest-ImagesNegativeTestJSON-153925992 tempest-ImagesNegativeTestJSON-153925992-project-member] Enqueued Resource ID: 460ab751-c0ea-45e9-bf76-9a767798212b with Priority: HIGHEST for action security_group_members [ 634.340733] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 460ab751-c0ea-45e9-bf76-9a767798212b with Priority: HIGHEST for action security_group_members [ 634.340733] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b8569476-f644-46f4-87dc-5a1d19af31a2',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 634.344975] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-460ab751-c0ea-45e9-bf76-9a767798212b taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.344975] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-460ab751-c0ea-45e9-bf76-9a767798212b" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.344975] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-460ab751-c0ea-45e9-bf76-9a767798212b" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.344975] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-460ab751-c0ea-45e9-bf76-9a767798212b" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.344975] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.344975] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.344975] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.344975] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.344975] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.344975] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('460ab751-c0ea-45e9-bf76-9a767798212b',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 634.839831] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 397559b2-3c5a-424d-b09d-43a25d2abba6 in Status: SUCCESS [ 634.839831] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-397559b2-3c5a-424d-b09d-43a25d2abba6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.840197] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-397559b2-3c5a-424d-b09d-43a25d2abba6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.840258] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-397559b2-3c5a-424d-b09d-43a25d2abba6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.843628] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.843628] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.843628] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.843628] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.843628] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.843628] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-397559b2-3c5a-424d-b09d-43a25d2abba6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.843628] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('397559b2-3c5a-424d-b09d-43a25d2abba6',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 634.846072] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.846218] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.846280] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.846429] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.846504] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.846597] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b8569476-f644-46f4-87dc-5a1d19af31a2 is going to be created. [ 634.847899] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.848037] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.848104] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.848235] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.848316] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.848488] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.848615] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.848667] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.849360] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.849360] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.849360] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 460ab751-c0ea-45e9-bf76-9a767798212b is going to be updated. [ 634.869720] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.869941] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.869941] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.872022] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.872022] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.878084] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.878306] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.878306] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.878468] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.878601] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.881141] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b8569476-f644-46f4-87dc-5a1d19af31a2 in Status: UNINITIALIZED for 2s [ 634.888151] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 460ab751-c0ea-45e9-bf76-9a767798212b in Status: IN_PROGRESS for 2s [ 635.333580] env[69188]: INFO networking_nsxv3.common.synchronization [req-ae655229-e6d0-4b45-982b-76f7dd85e538 req-a3087918-507c-4c49-bad8-ce91300dccec tempest-DeleteServersAdminTestJSON-1914332709 tempest-DeleteServersAdminTestJSON-1914332709-project-admin] Enqueued Resource ID: 8960cdd5-264d-45ae-a581-3531272dfbaa with Priority: HIGHEST for action security_group_members [ 635.333861] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8960cdd5-264d-45ae-a581-3531272dfbaa with Priority: HIGHEST for action security_group_members [ 635.334456] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-8960cdd5-264d-45ae-a581-3531272dfbaa taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.334715] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8960cdd5-264d-45ae-a581-3531272dfbaa" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.334715] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8960cdd5-264d-45ae-a581-3531272dfbaa" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.334854] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8960cdd5-264d-45ae-a581-3531272dfbaa" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.337226] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.337226] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.337226] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.337385] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.337385] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.337477] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8960cdd5-264d-45ae-a581-3531272dfbaa',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 635.344218] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-397559b2-3c5a-424d-b09d-43a25d2abba6 taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.344353] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-397559b2-3c5a-424d-b09d-43a25d2abba6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.344353] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-397559b2-3c5a-424d-b09d-43a25d2abba6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.344735] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-397559b2-3c5a-424d-b09d-43a25d2abba6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.344735] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.344954] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.344954] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.345079] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.346343] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.346997] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-397559b2-3c5a-424d-b09d-43a25d2abba6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.346997] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-397559b2-3c5a-424d-b09d-43a25d2abba6 taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.346997] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-397559b2-3c5a-424d-b09d-43a25d2abba6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.346997] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-397559b2-3c5a-424d-b09d-43a25d2abba6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.346997] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-397559b2-3c5a-424d-b09d-43a25d2abba6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.347388] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.347388] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.347388] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.347388] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.347388] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.347624] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-397559b2-3c5a-424d-b09d-43a25d2abba6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.347624] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('397559b2-3c5a-424d-b09d-43a25d2abba6',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 635.840553] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.840953] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.841257] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.843399] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.843596] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.843862] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.844027] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.844178] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.844410] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.844548] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.844690] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8960cdd5-264d-45ae-a581-3531272dfbaa is going to be updated. [ 635.851106] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 397559b2-3c5a-424d-b09d-43a25d2abba6: rpc.has_security_group_logging(os_id): False [ 635.869067] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.869205] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.869297] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.869574] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.869664] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.869889] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.869987] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.870061] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.870222] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.870298] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.870484] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.870577] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.870637] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.870774] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.870846] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.872099] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.872723] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.872723] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.872896] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.873016] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.873141] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 397559b2-3c5a-424d-b09d-43a25d2abba6 is going to be created. [ 635.876350] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.876509] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.876604] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.877070] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.877243] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.887204] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8960cdd5-264d-45ae-a581-3531272dfbaa in Status: IN_PROGRESS for 2s [ 635.941521] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.941742] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.941821] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.942595] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.942838] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.953357] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 397559b2-3c5a-424d-b09d-43a25d2abba6 in Status: IN_PROGRESS for 2s [ 635.955374] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9d153fe4-605f-47fe-a33b-9d019b977fa7 in Status: SUCCESS [ 635.956084] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9d153fe4-605f-47fe-a33b-9d019b977fa7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.890947] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b8569476-f644-46f4-87dc-5a1d19af31a2 in Status: SUCCESS [ 636.891459] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8569476-f644-46f4-87dc-5a1d19af31a2" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.893135] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8569476-f644-46f4-87dc-5a1d19af31a2" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.893135] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8569476-f644-46f4-87dc-5a1d19af31a2" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.893135] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.893135] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.893135] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.893135] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.893135] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.893135] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8569476-f644-46f4-87dc-5a1d19af31a2" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.893135] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b8569476-f644-46f4-87dc-5a1d19af31a2',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.894595] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 460ab751-c0ea-45e9-bf76-9a767798212b in Status: SUCCESS [ 636.894885] env[69188]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 460ab751-c0ea-45e9-bf76-9a767798212b deletion is rescheduled due to dependency. [ 636.895154] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-460ab751-c0ea-45e9-bf76-9a767798212b" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.398293] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8569476-f644-46f4-87dc-5a1d19af31a2 taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.398590] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8569476-f644-46f4-87dc-5a1d19af31a2" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.398590] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8569476-f644-46f4-87dc-5a1d19af31a2" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.399132] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8569476-f644-46f4-87dc-5a1d19af31a2" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.400140] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.400598] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.400684] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.400863] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.400959] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.401079] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8569476-f644-46f4-87dc-5a1d19af31a2" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.401478] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8569476-f644-46f4-87dc-5a1d19af31a2 taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.401478] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8569476-f644-46f4-87dc-5a1d19af31a2" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.401478] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8569476-f644-46f4-87dc-5a1d19af31a2" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.403993] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8569476-f644-46f4-87dc-5a1d19af31a2" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.403993] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.403993] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.403993] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.403993] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.403993] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.403993] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8569476-f644-46f4-87dc-5a1d19af31a2" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.403993] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b8569476-f644-46f4-87dc-5a1d19af31a2',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 637.652514] env[69188]: INFO networking_nsxv3.common.synchronization [None req-80747890-c444-4a5b-8cbe-5dd7b7779ea9 None None] Enqueued Resource ID: 2ee0c742-1379-4d08-a81a-e3bfc450db81 with Priority: HIGHEST for action port [ 637.652781] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ee0c742-1379-4d08-a81a-e3bfc450db81 with Priority: HIGHEST for action port [ 637.653505] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-2ee0c742-1379-4d08-a81a-e3bfc450db81 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.653620] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2ee0c742-1379-4d08-a81a-e3bfc450db81" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.653684] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2ee0c742-1379-4d08-a81a-e3bfc450db81" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.654763] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2ee0c742-1379-4d08-a81a-e3bfc450db81" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.654763] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2ee0c742-1379-4d08-a81a-e3bfc450db81',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 637.897362] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8960cdd5-264d-45ae-a581-3531272dfbaa in Status: SUCCESS [ 637.897639] env[69188]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8960cdd5-264d-45ae-a581-3531272dfbaa deletion is rescheduled due to dependency. [ 637.897639] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8960cdd5-264d-45ae-a581-3531272dfbaa" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.906204] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b8569476-f644-46f4-87dc-5a1d19af31a2: rpc.has_security_group_logging(os_id): False [ 637.924168] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.924168] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.924168] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.924168] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.924168] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.924168] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.924496] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.924496] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.924496] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.924585] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.924754] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.924850] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.924914] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.925085] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.925162] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.925479] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.925590] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.925656] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.925803] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.925932] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.926034] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b8569476-f644-46f4-87dc-5a1d19af31a2 is going to be created. [ 637.965353] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 397559b2-3c5a-424d-b09d-43a25d2abba6 in Status: SUCCESS [ 637.965581] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-397559b2-3c5a-424d-b09d-43a25d2abba6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.981111] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.981312] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.981395] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.981616] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.981819] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.993412] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b8569476-f644-46f4-87dc-5a1d19af31a2 in Status: IN_PROGRESS for 2s [ 638.156600] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2ee0c742-1379-4d08-a81a-e3bfc450db81 [ 638.157302] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.157302] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.157302] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.157302] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.157536] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.157536] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2ee0c742-1379-4d08-a81a-e3bfc450db81 already deleted. [ 638.157600] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2ee0c742-1379-4d08-a81a-e3bfc450db81" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.514075] env[69188]: INFO networking_nsxv3.common.synchronization [None req-f203e9cb-4002-4cb6-81ce-2d86d24fefb5 None None] Enqueued Resource ID: d0b7c45c-8601-4d9b-8635-ee3c3ee3bc5e with Priority: HIGHEST for action port [ 639.514925] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d0b7c45c-8601-4d9b-8635-ee3c3ee3bc5e with Priority: HIGHEST for action port [ 639.517049] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-d0b7c45c-8601-4d9b-8635-ee3c3ee3bc5e taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.517252] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d0b7c45c-8601-4d9b-8635-ee3c3ee3bc5e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.517328] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d0b7c45c-8601-4d9b-8635-ee3c3ee3bc5e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.517807] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d0b7c45c-8601-4d9b-8635-ee3c3ee3bc5e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.517918] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d0b7c45c-8601-4d9b-8635-ee3c3ee3bc5e',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.680784] env[69188]: INFO networking_nsxv3.common.synchronization [req-acb9bd04-55ce-4b70-acba-81f15d90a377 req-92064a5b-dd08-43d6-87d1-b3dc9e80a81a tempest-ServersTestJSON-1227074238 tempest-ServersTestJSON-1227074238-project-member] Enqueued Resource ID: 55dcb887-f0db-4969-b757-e829798327eb with Priority: HIGHEST for action security_group_members [ 639.681042] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55dcb887-f0db-4969-b757-e829798327eb with Priority: HIGHEST for action security_group_members [ 639.681311] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-55dcb887-f0db-4969-b757-e829798327eb taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.683222] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55dcb887-f0db-4969-b757-e829798327eb" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.683222] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55dcb887-f0db-4969-b757-e829798327eb" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.683222] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55dcb887-f0db-4969-b757-e829798327eb" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.683222] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.683222] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.683679] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.684427] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.684571] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.684648] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('55dcb887-f0db-4969-b757-e829798327eb',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.009626] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b8569476-f644-46f4-87dc-5a1d19af31a2 in Status: SUCCESS [ 640.010095] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b8569476-f644-46f4-87dc-5a1d19af31a2" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.022409] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d0b7c45c-8601-4d9b-8635-ee3c3ee3bc5e [ 640.022598] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.022741] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.022810] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.023042] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.023156] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.023231] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d0b7c45c-8601-4d9b-8635-ee3c3ee3bc5e already deleted. [ 640.024027] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d0b7c45c-8601-4d9b-8635-ee3c3ee3bc5e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.188641] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.188641] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.188641] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.191180] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.191180] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.191180] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.191180] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.191180] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.191180] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.191180] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.191180] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 55dcb887-f0db-4969-b757-e829798327eb already deleted. [ 640.191180] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55dcb887-f0db-4969-b757-e829798327eb" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.338204] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock network-215 taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.338417] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "network-215" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.338551] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "network-215" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.338899] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "network-215" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.339451] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.340227] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.340227] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.340461] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.340715] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.341045] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 640.341171] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] NeedRegenerationException {{(pid=69188) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 640.341601] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] no value, waiting for create lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 640.341711] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] value creation lock acquired {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 640.341850] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 640.342321] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Calling creation function for not-yet-present value {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 640.342497] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 640.362316] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 640.362624] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69188) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 640.362884] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Released creation lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 640.363302] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "network-215" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.364097] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock port-9ea43eb1-2bc7-4efa-b86b-51b6e7fd9b40 taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.364287] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "port-9ea43eb1-2bc7-4efa-b86b-51b6e7fd9b40" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.364525] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "port-9ea43eb1-2bc7-4efa-b86b-51b6e7fd9b40" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.364863] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "port-9ea43eb1-2bc7-4efa-b86b-51b6e7fd9b40" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.365077] env[69188]: DEBUG networking_nsxv3.api.rpc [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9ea43eb1-2bc7-4efa-b86b-51b6e7fd9b40',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.752490] env[69188]: INFO networking_nsxv3.common.synchronization [req-cd6c6359-8635-4818-ae91-8d0193a8b459 req-b88f0c04-9e62-4467-b8ed-7c52d43856bd tempest-ServerDiagnosticsNegativeTest-520481446 tempest-ServerDiagnosticsNegativeTest-520481446-project-member] Enqueued Resource ID: e1f5743d-088c-4b6d-9680-d1a339199c95 with Priority: HIGHEST for action security_group_members [ 640.753024] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e1f5743d-088c-4b6d-9680-d1a339199c95 with Priority: HIGHEST for action security_group_members [ 640.754425] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-e1f5743d-088c-4b6d-9680-d1a339199c95 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.754425] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e1f5743d-088c-4b6d-9680-d1a339199c95" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.754425] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e1f5743d-088c-4b6d-9680-d1a339199c95" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.754425] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e1f5743d-088c-4b6d-9680-d1a339199c95" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.754425] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.754425] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.754425] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.754425] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.754425] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.754425] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e1f5743d-088c-4b6d-9680-d1a339199c95',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.867548] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.867679] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.867893] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.870018] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.870018] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.870018] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Segment Port 9ea43eb1-2bc7-4efa-b86b-51b6e7fd9b40 not found, creating... [ 640.870018] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.870018] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.870018] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.870018] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.870018] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.870018] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.870407] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.870407] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.870541] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.870672] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.870816] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Resource: SegmentPort with ID: 9ea43eb1-2bc7-4efa-b86b-51b6e7fd9b40 is going to be created. [ 640.889920] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.890158] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.890332] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.890563] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.890794] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.891057] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "port-9ea43eb1-2bc7-4efa-b86b-51b6e7fd9b40" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.257033] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.257033] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.257192] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.258978] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.258978] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.258978] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.258978] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.258978] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.258978] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.258978] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.258978] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e1f5743d-088c-4b6d-9680-d1a339199c95 is going to be updated. [ 641.285779] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.286008] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.286184] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.286437] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.286646] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.298844] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e1f5743d-088c-4b6d-9680-d1a339199c95 in Status: IN_PROGRESS for 2s [ 641.838585] env[69188]: INFO networking_nsxv3.common.synchronization [req-acb9bd04-55ce-4b70-acba-81f15d90a377 req-0b018d92-40b6-4aee-a453-855686e12441 service nova] Enqueued Resource ID: 55dcb887-f0db-4969-b757-e829798327eb with Priority: HIGHEST for action security_group_rules [ 641.838585] env[69188]: INFO networking_nsxv3.common.synchronization [req-acb9bd04-55ce-4b70-acba-81f15d90a377 req-0b018d92-40b6-4aee-a453-855686e12441 service nova] Enqueued Resource ID: 55dcb887-f0db-4969-b757-e829798327eb with Priority: HIGHEST for action security_group_members [ 641.838585] env[69188]: INFO networking_nsxv3.common.synchronization [req-acb9bd04-55ce-4b70-acba-81f15d90a377 req-0b018d92-40b6-4aee-a453-855686e12441 service nova] Enqueued Resource ID: 9ea43eb1-2bc7-4efa-b86b-51b6e7fd9b40 with Priority: HIGHEST for action port [ 641.838585] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55dcb887-f0db-4969-b757-e829798327eb with Priority: HIGHEST for action security_group_rules [ 641.838585] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55dcb887-f0db-4969-b757-e829798327eb with Priority: HIGHEST for action security_group_members [ 641.838585] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ea43eb1-2bc7-4efa-b86b-51b6e7fd9b40 with Priority: HIGHEST for action port [ 641.839033] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-55dcb887-f0db-4969-b757-e829798327eb taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.839033] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-55dcb887-f0db-4969-b757-e829798327eb" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.839033] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-55dcb887-f0db-4969-b757-e829798327eb" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.839310] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-55dcb887-f0db-4969-b757-e829798327eb" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.840204] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('55dcb887-f0db-4969-b757-e829798327eb',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.840996] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-55dcb887-f0db-4969-b757-e829798327eb taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.841114] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55dcb887-f0db-4969-b757-e829798327eb" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.841430] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55dcb887-f0db-4969-b757-e829798327eb" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.841430] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55dcb887-f0db-4969-b757-e829798327eb" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.841519] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.841794] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.841794] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.841794] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.841907] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.842032] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('55dcb887-f0db-4969-b757-e829798327eb',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.842719] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-9ea43eb1-2bc7-4efa-b86b-51b6e7fd9b40 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.846332] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9ea43eb1-2bc7-4efa-b86b-51b6e7fd9b40" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.846391] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9ea43eb1-2bc7-4efa-b86b-51b6e7fd9b40" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.846953] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9ea43eb1-2bc7-4efa-b86b-51b6e7fd9b40" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.846953] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9ea43eb1-2bc7-4efa-b86b-51b6e7fd9b40',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.348411] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('55dcb887-f0db-4969-b757-e829798327eb',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.349640] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-55dcb887-f0db-4969-b757-e829798327eb taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.349774] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55dcb887-f0db-4969-b757-e829798327eb" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.350251] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9ea43eb1-2bc7-4efa-b86b-51b6e7fd9b40 with status ACTIVE [ 642.350486] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.350658] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.350742] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.350991] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.353017] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.353308] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.353589] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.353589] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.353764] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.354209] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.354209] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.354209] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.354366] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.354408] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.355065] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.355065] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9ea43eb1-2bc7-4efa-b86b-51b6e7fd9b40 is going to be updated. [ 642.377554] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.377747] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.377850] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.378109] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.378209] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.378667] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9ea43eb1-2bc7-4efa-b86b-51b6e7fd9b40" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.591121] env[69188]: INFO networking_nsxv3.common.synchronization [None req-28d1e416-2dad-404f-9a46-b08ccc1929f9 None None] Enqueued Resource ID: d8dcc743-183f-4f16-a9d9-c4791b94f4e8 with Priority: HIGHEST for action port [ 642.591828] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d8dcc743-183f-4f16-a9d9-c4791b94f4e8 with Priority: HIGHEST for action port [ 642.592962] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-d8dcc743-183f-4f16-a9d9-c4791b94f4e8 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.593187] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d8dcc743-183f-4f16-a9d9-c4791b94f4e8" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.593279] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d8dcc743-183f-4f16-a9d9-c4791b94f4e8" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.594192] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d8dcc743-183f-4f16-a9d9-c4791b94f4e8" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.594192] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d8dcc743-183f-4f16-a9d9-c4791b94f4e8',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.860799] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('55dcb887-f0db-4969-b757-e829798327eb',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.975439] env[69188]: INFO networking_nsxv3.common.synchronization [req-5815ef3c-7313-46cf-9f20-a9f509e3540d req-2ea5faf8-b840-4655-946d-dc90b3e30b43 tempest-ServerExternalEventsTest-1851765045 tempest-ServerExternalEventsTest-1851765045-project-member] Enqueued Resource ID: 4e9db3bb-e903-42d7-b7e6-e365ea0c7f5f with Priority: HIGHEST for action security_group_members [ 642.975975] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e9db3bb-e903-42d7-b7e6-e365ea0c7f5f with Priority: HIGHEST for action security_group_members [ 642.977251] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-4e9db3bb-e903-42d7-b7e6-e365ea0c7f5f taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.977413] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4e9db3bb-e903-42d7-b7e6-e365ea0c7f5f" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.977476] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4e9db3bb-e903-42d7-b7e6-e365ea0c7f5f" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.977730] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4e9db3bb-e903-42d7-b7e6-e365ea0c7f5f" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.977893] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.977999] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.978148] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.978272] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.978330] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.978416] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4e9db3bb-e903-42d7-b7e6-e365ea0c7f5f',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 643.097583] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d8dcc743-183f-4f16-a9d9-c4791b94f4e8 [ 643.097819] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.097953] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.098048] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.098292] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.098439] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.098484] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d8dcc743-183f-4f16-a9d9-c4791b94f4e8 already deleted. [ 643.098553] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d8dcc743-183f-4f16-a9d9-c4791b94f4e8" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.310441] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e1f5743d-088c-4b6d-9680-d1a339199c95 in Status: SUCCESS [ 643.310441] env[69188]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e1f5743d-088c-4b6d-9680-d1a339199c95 deletion is rescheduled due to dependency. [ 643.310441] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e1f5743d-088c-4b6d-9680-d1a339199c95" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.371424] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.371424] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.371424] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.371424] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.371424] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.371424] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 55dcb887-f0db-4969-b757-e829798327eb is going to be created. [ 643.396276] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.396276] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.396276] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.396276] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.396276] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.406780] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 55dcb887-f0db-4969-b757-e829798327eb in Status: UNINITIALIZED for 2s [ 643.483474] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.483474] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.483474] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.486522] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.486606] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.487145] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.487145] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.487145] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.487290] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.487404] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.487484] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4e9db3bb-e903-42d7-b7e6-e365ea0c7f5f already deleted. [ 643.487622] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4e9db3bb-e903-42d7-b7e6-e365ea0c7f5f" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.689039] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock network-267 taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.689224] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "network-267" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.689358] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "network-267" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.689643] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "network-267" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.690534] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.690796] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.690853] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.691653] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.691653] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.691653] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 643.691653] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] NeedRegenerationException {{(pid=69188) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 643.691653] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] no value, waiting for create lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 643.692730] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] value creation lock acquired {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 643.692730] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 643.692730] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Calling creation function for not-yet-present value {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 643.692730] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 643.722369] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 643.722539] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Cache value generated in 0.030 seconds for key(s): 'zone-id' {{(pid=69188) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 643.722679] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Released creation lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 643.725492] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "network-267" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.725492] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock port-7fc505fe-036c-4502-a906-e8bfc4cf0f43 taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.725492] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "port-7fc505fe-036c-4502-a906-e8bfc4cf0f43" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.725492] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "port-7fc505fe-036c-4502-a906-e8bfc4cf0f43" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.725492] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "port-7fc505fe-036c-4502-a906-e8bfc4cf0f43" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.725492] env[69188]: DEBUG networking_nsxv3.api.rpc [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7fc505fe-036c-4502-a906-e8bfc4cf0f43',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.230979] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.231542] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.231542] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.231892] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.231892] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.232278] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Segment Port 7fc505fe-036c-4502-a906-e8bfc4cf0f43 not found, creating... [ 644.232653] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.232964] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.232964] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.233214] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.233539] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.233872] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.234238] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.234238] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.234412] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.234555] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.234922] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Resource: SegmentPort with ID: 7fc505fe-036c-4502-a906-e8bfc4cf0f43 is going to be created. [ 644.253210] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.253472] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.253683] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.253944] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.254199] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.254419] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "port-7fc505fe-036c-4502-a906-e8bfc4cf0f43" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.475930] env[69188]: INFO networking_nsxv3.common.synchronization [req-5c4b1f28-4a8c-4ad2-882d-ee59c19d0388 req-573928f2-6661-4c0a-801a-7fcc1d21c289 tempest-FloatingIPsAssociationTestJSON-209902533 tempest-FloatingIPsAssociationTestJSON-209902533-project-member] Enqueued Resource ID: 53b2b927-2e3d-4111-b25a-7b34ab9fa28d with Priority: HIGHEST for action security_group_members [ 644.476671] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 53b2b927-2e3d-4111-b25a-7b34ab9fa28d with Priority: HIGHEST for action security_group_members [ 644.477091] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-53b2b927-2e3d-4111-b25a-7b34ab9fa28d taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.477810] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-53b2b927-2e3d-4111-b25a-7b34ab9fa28d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.479908] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-53b2b927-2e3d-4111-b25a-7b34ab9fa28d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.479908] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-53b2b927-2e3d-4111-b25a-7b34ab9fa28d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.479908] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.479908] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.479908] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.479908] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.479908] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.479908] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('53b2b927-2e3d-4111-b25a-7b34ab9fa28d',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.490822] env[69188]: INFO networking_nsxv3.common.synchronization [None req-0638d618-510e-4626-88bd-7fb854a340b9 None None] Enqueued Resource ID: 92c5cde4-11d1-49c9-8657-653ccb43462e with Priority: HIGHEST for action port [ 644.490822] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 92c5cde4-11d1-49c9-8657-653ccb43462e with Priority: HIGHEST for action port [ 644.490822] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-92c5cde4-11d1-49c9-8657-653ccb43462e taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.490822] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-92c5cde4-11d1-49c9-8657-653ccb43462e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.490822] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-92c5cde4-11d1-49c9-8657-653ccb43462e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.490822] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-92c5cde4-11d1-49c9-8657-653ccb43462e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.490822] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('92c5cde4-11d1-49c9-8657-653ccb43462e',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.981853] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.981853] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.981853] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.982147] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.982147] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.982398] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.982516] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.982583] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.982820] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.982873] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.982949] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 53b2b927-2e3d-4111-b25a-7b34ab9fa28d already deleted. [ 644.983141] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-53b2b927-2e3d-4111-b25a-7b34ab9fa28d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.994939] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 92c5cde4-11d1-49c9-8657-653ccb43462e [ 644.994939] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.994939] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.994939] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.994939] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.994939] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.994939] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:92c5cde4-11d1-49c9-8657-653ccb43462e already deleted. [ 644.994939] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-92c5cde4-11d1-49c9-8657-653ccb43462e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.056825] env[69188]: INFO networking_nsxv3.common.synchronization [req-5815ef3c-7313-46cf-9f20-a9f509e3540d req-5550cfe2-20ab-40b8-a9ea-c5e8d6914140 service nova] Enqueued Resource ID: 4e9db3bb-e903-42d7-b7e6-e365ea0c7f5f with Priority: HIGHEST for action security_group_rules [ 645.058075] env[69188]: INFO networking_nsxv3.common.synchronization [req-5815ef3c-7313-46cf-9f20-a9f509e3540d req-5550cfe2-20ab-40b8-a9ea-c5e8d6914140 service nova] Enqueued Resource ID: 4e9db3bb-e903-42d7-b7e6-e365ea0c7f5f with Priority: HIGHEST for action security_group_members [ 645.058075] env[69188]: INFO networking_nsxv3.common.synchronization [req-5815ef3c-7313-46cf-9f20-a9f509e3540d req-5550cfe2-20ab-40b8-a9ea-c5e8d6914140 service nova] Enqueued Resource ID: 7fc505fe-036c-4502-a906-e8bfc4cf0f43 with Priority: HIGHEST for action port [ 645.059219] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e9db3bb-e903-42d7-b7e6-e365ea0c7f5f with Priority: HIGHEST for action security_group_rules [ 645.059966] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e9db3bb-e903-42d7-b7e6-e365ea0c7f5f with Priority: HIGHEST for action security_group_members [ 645.061151] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7fc505fe-036c-4502-a906-e8bfc4cf0f43 with Priority: HIGHEST for action port [ 645.061151] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4e9db3bb-e903-42d7-b7e6-e365ea0c7f5f taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.061151] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4e9db3bb-e903-42d7-b7e6-e365ea0c7f5f" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.061151] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4e9db3bb-e903-42d7-b7e6-e365ea0c7f5f" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.061151] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4e9db3bb-e903-42d7-b7e6-e365ea0c7f5f" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.061151] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4e9db3bb-e903-42d7-b7e6-e365ea0c7f5f',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.062912] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-4e9db3bb-e903-42d7-b7e6-e365ea0c7f5f taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.062912] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4e9db3bb-e903-42d7-b7e6-e365ea0c7f5f" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.062912] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4e9db3bb-e903-42d7-b7e6-e365ea0c7f5f" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.063305] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4e9db3bb-e903-42d7-b7e6-e365ea0c7f5f" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.063471] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.063575] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.063663] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.063883] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.063976] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.064266] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4e9db3bb-e903-42d7-b7e6-e365ea0c7f5f',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.065550] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-7fc505fe-036c-4502-a906-e8bfc4cf0f43 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.065550] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7fc505fe-036c-4502-a906-e8bfc4cf0f43" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.065550] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7fc505fe-036c-4502-a906-e8bfc4cf0f43" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.065740] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7fc505fe-036c-4502-a906-e8bfc4cf0f43" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.069051] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7fc505fe-036c-4502-a906-e8bfc4cf0f43',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.375459] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock network-66 taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.375872] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "network-66" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.375872] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "network-66" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.376266] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "network-66" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.376576] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.376745] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.376866] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.377242] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.377527] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.377857] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 645.378100] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] NeedRegenerationException {{(pid=69188) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 645.379395] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] no value, waiting for create lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 645.379395] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] value creation lock acquired {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 645.379395] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 645.379395] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Calling creation function for not-yet-present value {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 645.379395] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 645.398869] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 645.399059] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69188) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 645.399212] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Released creation lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 645.399397] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "network-66" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.399737] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock port-89926c03-29a8-4b6e-839d-f40ff95ec996 taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.399937] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "port-89926c03-29a8-4b6e-839d-f40ff95ec996" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.400105] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "port-89926c03-29a8-4b6e-839d-f40ff95ec996" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.400471] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "port-89926c03-29a8-4b6e-839d-f40ff95ec996" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.400611] env[69188]: DEBUG networking_nsxv3.api.rpc [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('89926c03-29a8-4b6e-839d-f40ff95ec996',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.416273] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 55dcb887-f0db-4969-b757-e829798327eb in Status: SUCCESS [ 645.416273] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55dcb887-f0db-4969-b757-e829798327eb" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.416273] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55dcb887-f0db-4969-b757-e829798327eb" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.416273] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55dcb887-f0db-4969-b757-e829798327eb" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.416273] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.416627] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.416627] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.416627] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.416745] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.417887] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55dcb887-f0db-4969-b757-e829798327eb" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.417887] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('55dcb887-f0db-4969-b757-e829798327eb',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.571299] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-4e9db3bb-e903-42d7-b7e6-e365ea0c7f5f taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.571499] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4e9db3bb-e903-42d7-b7e6-e365ea0c7f5f" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.571675] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4e9db3bb-e903-42d7-b7e6-e365ea0c7f5f',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.573691] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7fc505fe-036c-4502-a906-e8bfc4cf0f43 with status ACTIVE [ 645.574106] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.574418] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.574640] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.576338] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.576338] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.576338] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.576338] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.576338] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.576338] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.576338] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.584162] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.584162] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.584162] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.584162] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.584162] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.584162] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7fc505fe-036c-4502-a906-e8bfc4cf0f43 is going to be updated. [ 645.602285] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.602285] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.602285] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.602285] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.602285] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.602285] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7fc505fe-036c-4502-a906-e8bfc4cf0f43" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.722663] env[69188]: INFO networking_nsxv3.common.synchronization [req-dc3dd1c6-f22e-4213-a298-779635baad7c req-71cca039-dc2c-4119-91e9-e991e5241b0c tempest-DeleteServersTestJSON-857706435 tempest-DeleteServersTestJSON-857706435-project-member] Enqueued Resource ID: 397559b2-3c5a-424d-b09d-43a25d2abba6 with Priority: HIGHEST for action security_group_members [ 645.726484] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 397559b2-3c5a-424d-b09d-43a25d2abba6 with Priority: HIGHEST for action security_group_members [ 645.726484] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-397559b2-3c5a-424d-b09d-43a25d2abba6 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.726484] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-397559b2-3c5a-424d-b09d-43a25d2abba6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.726484] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-397559b2-3c5a-424d-b09d-43a25d2abba6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.726484] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-397559b2-3c5a-424d-b09d-43a25d2abba6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.726484] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.726484] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.726484] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.726484] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.726484] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.726484] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('397559b2-3c5a-424d-b09d-43a25d2abba6',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.903284] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.903442] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.906520] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.906520] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.906520] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.906520] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Segment Port 89926c03-29a8-4b6e-839d-f40ff95ec996 not found, creating... [ 645.906520] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.906520] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.906520] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.906520] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.906520] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.906520] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.907058] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.907058] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.907058] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.907058] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.907058] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Resource: SegmentPort with ID: 89926c03-29a8-4b6e-839d-f40ff95ec996 is going to be created. [ 645.922967] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('55dcb887-f0db-4969-b757-e829798327eb',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.927812] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.928040] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.928169] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.928487] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.928725] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.928956] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "port-89926c03-29a8-4b6e-839d-f40ff95ec996" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.088184] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4e9db3bb-e903-42d7-b7e6-e365ea0c7f5f',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.227984] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.228164] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.228235] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.228510] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.228607] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.228796] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.228900] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.228965] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.229126] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.229199] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.229284] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 397559b2-3c5a-424d-b09d-43a25d2abba6 is going to be updated. [ 646.254828] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.254828] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.254998] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.255132] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.255273] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.263449] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 397559b2-3c5a-424d-b09d-43a25d2abba6 in Status: IN_PROGRESS for 2s [ 646.433873] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 55dcb887-f0db-4969-b757-e829798327eb: rpc.has_security_group_logging(os_id): False [ 646.449880] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.449880] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.450126] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.450241] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.450295] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.450513] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.450640] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.450797] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.450867] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.450915] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.450968] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 55dcb887-f0db-4969-b757-e829798327eb is going to be created. [ 646.509050] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.509050] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.509050] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.509050] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.509050] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.522765] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 55dcb887-f0db-4969-b757-e829798327eb in Status: IN_PROGRESS for 2s [ 646.591166] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.591322] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.591382] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.591637] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.591728] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.591830] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4e9db3bb-e903-42d7-b7e6-e365ea0c7f5f is going to be created. [ 646.639147] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.639327] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.639413] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.639695] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.639893] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.653358] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4e9db3bb-e903-42d7-b7e6-e365ea0c7f5f in Status: UNINITIALIZED for 2s [ 647.325227] env[69188]: INFO networking_nsxv3.common.synchronization [req-e314b4de-3af8-4dc5-a6cc-b441a492a905 req-bc14301f-7c97-420d-91c3-4c6a8af6b190 tempest-VolumesAssistedSnapshotsTest-1534843512 tempest-VolumesAssistedSnapshotsTest-1534843512-project-member] Enqueued Resource ID: 3cd8cf7d-5793-4464-821e-78828cb956a9 with Priority: HIGHEST for action security_group_members [ 647.325743] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3cd8cf7d-5793-4464-821e-78828cb956a9 with Priority: HIGHEST for action security_group_members [ 647.326063] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-3cd8cf7d-5793-4464-821e-78828cb956a9 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.326301] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3cd8cf7d-5793-4464-821e-78828cb956a9" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.326301] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3cd8cf7d-5793-4464-821e-78828cb956a9" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.326495] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3cd8cf7d-5793-4464-821e-78828cb956a9" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.328110] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.328255] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.330730] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.330930] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.331039] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.331147] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3cd8cf7d-5793-4464-821e-78828cb956a9',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 647.833293] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.833546] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.833546] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.834462] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.834462] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.834462] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.834462] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.834462] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.834462] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.834462] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.834462] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3cd8cf7d-5793-4464-821e-78828cb956a9 already deleted. [ 647.834827] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3cd8cf7d-5793-4464-821e-78828cb956a9" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.928090] env[69188]: INFO networking_nsxv3.common.synchronization [req-5c4b1f28-4a8c-4ad2-882d-ee59c19d0388 req-f6580444-84e2-4b91-bbea-0b78bb9fe7b0 service nova] Enqueued Resource ID: 53b2b927-2e3d-4111-b25a-7b34ab9fa28d with Priority: HIGHEST for action security_group_rules [ 647.928312] env[69188]: INFO networking_nsxv3.common.synchronization [req-5c4b1f28-4a8c-4ad2-882d-ee59c19d0388 req-f6580444-84e2-4b91-bbea-0b78bb9fe7b0 service nova] Enqueued Resource ID: 53b2b927-2e3d-4111-b25a-7b34ab9fa28d with Priority: HIGHEST for action security_group_members [ 647.928432] env[69188]: INFO networking_nsxv3.common.synchronization [req-5c4b1f28-4a8c-4ad2-882d-ee59c19d0388 req-f6580444-84e2-4b91-bbea-0b78bb9fe7b0 service nova] Enqueued Resource ID: 89926c03-29a8-4b6e-839d-f40ff95ec996 with Priority: HIGHEST for action port [ 647.928662] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 53b2b927-2e3d-4111-b25a-7b34ab9fa28d with Priority: HIGHEST for action security_group_rules [ 647.928791] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 53b2b927-2e3d-4111-b25a-7b34ab9fa28d with Priority: HIGHEST for action security_group_members [ 647.928887] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 89926c03-29a8-4b6e-839d-f40ff95ec996 with Priority: HIGHEST for action port [ 647.929516] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-53b2b927-2e3d-4111-b25a-7b34ab9fa28d taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.929640] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-53b2b927-2e3d-4111-b25a-7b34ab9fa28d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.929722] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-53b2b927-2e3d-4111-b25a-7b34ab9fa28d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.929964] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-53b2b927-2e3d-4111-b25a-7b34ab9fa28d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.930058] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('53b2b927-2e3d-4111-b25a-7b34ab9fa28d',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 647.930971] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-53b2b927-2e3d-4111-b25a-7b34ab9fa28d taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.931113] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-53b2b927-2e3d-4111-b25a-7b34ab9fa28d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.931113] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-53b2b927-2e3d-4111-b25a-7b34ab9fa28d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.931250] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-53b2b927-2e3d-4111-b25a-7b34ab9fa28d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.931466] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.931534] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.931534] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.931686] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.931780] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.931868] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('53b2b927-2e3d-4111-b25a-7b34ab9fa28d',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 647.933258] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-89926c03-29a8-4b6e-839d-f40ff95ec996 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.933258] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-89926c03-29a8-4b6e-839d-f40ff95ec996" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.933258] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-89926c03-29a8-4b6e-839d-f40ff95ec996" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.933258] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-89926c03-29a8-4b6e-839d-f40ff95ec996" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.933258] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('89926c03-29a8-4b6e-839d-f40ff95ec996',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.273298] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 397559b2-3c5a-424d-b09d-43a25d2abba6 in Status: SUCCESS [ 648.273519] env[69188]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 397559b2-3c5a-424d-b09d-43a25d2abba6 deletion is rescheduled due to dependency. [ 648.273637] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-397559b2-3c5a-424d-b09d-43a25d2abba6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.434720] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('53b2b927-2e3d-4111-b25a-7b34ab9fa28d',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.435767] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-53b2b927-2e3d-4111-b25a-7b34ab9fa28d taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.435943] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-53b2b927-2e3d-4111-b25a-7b34ab9fa28d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.437209] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 89926c03-29a8-4b6e-839d-f40ff95ec996 with status ACTIVE [ 648.437209] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.437209] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.437209] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.437510] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.437544] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.437719] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.437820] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.437884] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.438062] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.438386] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.438780] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.438871] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.438871] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.439016] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.439124] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.439250] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 89926c03-29a8-4b6e-839d-f40ff95ec996 is going to be updated. [ 648.459566] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.459748] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.459788] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.460846] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.460846] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.460846] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-89926c03-29a8-4b6e-839d-f40ff95ec996" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.522196] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock network-171 taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.522196] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "network-171" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.522196] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "network-171" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.522522] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "network-171" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.523181] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.525322] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.525486] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.526527] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.526527] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.526527] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 648.526527] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] NeedRegenerationException {{(pid=69188) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 648.526527] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] no value, waiting for create lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 648.528406] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] value creation lock acquired {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 648.528406] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 648.528406] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Calling creation function for not-yet-present value {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 648.528406] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 648.545962] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 55dcb887-f0db-4969-b757-e829798327eb in Status: SUCCESS [ 648.546343] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-55dcb887-f0db-4969-b757-e829798327eb" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.552605] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 648.552816] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=69188) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 648.552930] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Released creation lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 648.553129] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "network-171" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.553603] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock port-dcf8155c-ab4b-4fe2-9f4f-3809905255b3 taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.553788] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "port-dcf8155c-ab4b-4fe2-9f4f-3809905255b3" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.553929] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "port-dcf8155c-ab4b-4fe2-9f4f-3809905255b3" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.554279] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "port-dcf8155c-ab4b-4fe2-9f4f-3809905255b3" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.554418] env[69188]: DEBUG networking_nsxv3.api.rpc [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dcf8155c-ab4b-4fe2-9f4f-3809905255b3',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.594527] env[69188]: INFO networking_nsxv3.common.synchronization [None req-c8add690-130e-44e3-b87e-259668001ab2 None None] Enqueued Resource ID: f2d704b7-a409-4652-babb-dfdb44fc7c78 with Priority: HIGHEST for action port [ 648.595209] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f2d704b7-a409-4652-babb-dfdb44fc7c78 with Priority: HIGHEST for action port [ 648.595641] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-f2d704b7-a409-4652-babb-dfdb44fc7c78 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.595739] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f2d704b7-a409-4652-babb-dfdb44fc7c78" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.595788] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f2d704b7-a409-4652-babb-dfdb44fc7c78" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.599694] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f2d704b7-a409-4652-babb-dfdb44fc7c78" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.599694] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f2d704b7-a409-4652-babb-dfdb44fc7c78',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.663153] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4e9db3bb-e903-42d7-b7e6-e365ea0c7f5f in Status: UNINITIALIZED for 4s [ 648.937478] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('53b2b927-2e3d-4111-b25a-7b34ab9fa28d',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.030035] env[69188]: INFO networking_nsxv3.common.synchronization [None req-d6528fec-bce0-4d47-8dae-f129d96074da None None] Enqueued Resource ID: f0911533-a660-4978-8c59-6cb10962bb96 with Priority: HIGHEST for action port [ 649.030035] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f0911533-a660-4978-8c59-6cb10962bb96 with Priority: HIGHEST for action port [ 649.031385] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-f0911533-a660-4978-8c59-6cb10962bb96 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.031385] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f0911533-a660-4978-8c59-6cb10962bb96" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.031385] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f0911533-a660-4978-8c59-6cb10962bb96" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.031385] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f0911533-a660-4978-8c59-6cb10962bb96" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.031385] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f0911533-a660-4978-8c59-6cb10962bb96',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.057624] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.057751] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.057953] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.058143] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.058262] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.058506] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Segment Port dcf8155c-ab4b-4fe2-9f4f-3809905255b3 not found, creating... [ 649.058686] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.058837] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.058977] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.059263] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.059323] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.060173] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.060173] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.060173] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.060173] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.060704] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.060704] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Resource: SegmentPort with ID: dcf8155c-ab4b-4fe2-9f4f-3809905255b3 is going to be created. [ 649.087784] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.087784] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.087784] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.087784] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.087784] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.087784] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "port-dcf8155c-ab4b-4fe2-9f4f-3809905255b3" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.103635] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f2d704b7-a409-4652-babb-dfdb44fc7c78 [ 649.105496] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.105496] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.105496] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.105496] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.105496] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.105496] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f2d704b7-a409-4652-babb-dfdb44fc7c78 already deleted. [ 649.105496] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f2d704b7-a409-4652-babb-dfdb44fc7c78" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.443471] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.443471] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.443471] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.443471] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.443471] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.443471] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 53b2b927-2e3d-4111-b25a-7b34ab9fa28d is going to be created. [ 649.472786] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.472786] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.472911] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.473117] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.473283] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.499255] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 53b2b927-2e3d-4111-b25a-7b34ab9fa28d in Status: UNINITIALIZED for 2s [ 649.499255] env[69188]: INFO networking_nsxv3.common.synchronization [None req-7c4abd25-1650-4c1b-91bd-748e5e1426ae None None] Enqueued Resource ID: 8c1905d3-fbb1-47f6-b4f4-b394e8fb6165 with Priority: HIGHEST for action port [ 649.500648] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c1905d3-fbb1-47f6-b4f4-b394e8fb6165 with Priority: HIGHEST for action port [ 649.500648] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-8c1905d3-fbb1-47f6-b4f4-b394e8fb6165 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.500648] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8c1905d3-fbb1-47f6-b4f4-b394e8fb6165" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.500648] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8c1905d3-fbb1-47f6-b4f4-b394e8fb6165" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.501092] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8c1905d3-fbb1-47f6-b4f4-b394e8fb6165" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.501092] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8c1905d3-fbb1-47f6-b4f4-b394e8fb6165',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.535095] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f0911533-a660-4978-8c59-6cb10962bb96 [ 649.535095] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.535095] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.535789] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.536228] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.536228] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.536385] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f0911533-a660-4978-8c59-6cb10962bb96 already deleted. [ 649.536385] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f0911533-a660-4978-8c59-6cb10962bb96" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.005428] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8c1905d3-fbb1-47f6-b4f4-b394e8fb6165 [ 650.005661] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.007063] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.007063] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.007063] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.007063] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.007063] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8c1905d3-fbb1-47f6-b4f4-b394e8fb6165 already deleted. [ 650.007063] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8c1905d3-fbb1-47f6-b4f4-b394e8fb6165" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.676481] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4e9db3bb-e903-42d7-b7e6-e365ea0c7f5f in Status: SUCCESS [ 650.679336] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4e9db3bb-e903-42d7-b7e6-e365ea0c7f5f" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.679336] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4e9db3bb-e903-42d7-b7e6-e365ea0c7f5f" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.679336] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4e9db3bb-e903-42d7-b7e6-e365ea0c7f5f" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.679336] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.679336] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.679336] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.679336] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.679336] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.679336] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4e9db3bb-e903-42d7-b7e6-e365ea0c7f5f" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.679336] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4e9db3bb-e903-42d7-b7e6-e365ea0c7f5f',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.184133] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-4e9db3bb-e903-42d7-b7e6-e365ea0c7f5f taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.185107] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4e9db3bb-e903-42d7-b7e6-e365ea0c7f5f" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.185107] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4e9db3bb-e903-42d7-b7e6-e365ea0c7f5f" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.185107] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4e9db3bb-e903-42d7-b7e6-e365ea0c7f5f" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.185445] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.185550] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.185619] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.185785] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.185876] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.185959] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4e9db3bb-e903-42d7-b7e6-e365ea0c7f5f" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.186270] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-4e9db3bb-e903-42d7-b7e6-e365ea0c7f5f taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.186323] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4e9db3bb-e903-42d7-b7e6-e365ea0c7f5f" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.186398] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4e9db3bb-e903-42d7-b7e6-e365ea0c7f5f" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.186587] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4e9db3bb-e903-42d7-b7e6-e365ea0c7f5f" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.188458] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.188628] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.188628] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.188781] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.189263] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.189263] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4e9db3bb-e903-42d7-b7e6-e365ea0c7f5f" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.189263] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4e9db3bb-e903-42d7-b7e6-e365ea0c7f5f',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.319697] env[69188]: INFO networking_nsxv3.common.synchronization [req-7fe6ef7a-e9d8-4a96-a93d-f95c3ab279b4 req-18239395-320b-4264-9800-9a4f61bde91b tempest-MigrationsAdminTest-718349773 tempest-MigrationsAdminTest-718349773-project-member] Enqueued Resource ID: 345a1564-5c47-4d81-9096-66a6ad96570a with Priority: HIGHEST for action security_group_members [ 651.320265] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 345a1564-5c47-4d81-9096-66a6ad96570a with Priority: HIGHEST for action security_group_members [ 651.320653] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-345a1564-5c47-4d81-9096-66a6ad96570a taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.320799] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-345a1564-5c47-4d81-9096-66a6ad96570a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.320799] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-345a1564-5c47-4d81-9096-66a6ad96570a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.321486] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-345a1564-5c47-4d81-9096-66a6ad96570a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.321672] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.322424] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.322424] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.322424] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.322424] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.322424] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('345a1564-5c47-4d81-9096-66a6ad96570a',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.507516] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 53b2b927-2e3d-4111-b25a-7b34ab9fa28d in Status: SUCCESS [ 651.507862] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-53b2b927-2e3d-4111-b25a-7b34ab9fa28d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.508330] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-53b2b927-2e3d-4111-b25a-7b34ab9fa28d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.508662] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-53b2b927-2e3d-4111-b25a-7b34ab9fa28d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.509170] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.509371] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.509995] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.510254] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.510428] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.510599] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-53b2b927-2e3d-4111-b25a-7b34ab9fa28d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.510709] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('53b2b927-2e3d-4111-b25a-7b34ab9fa28d',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.680344] env[69188]: INFO networking_nsxv3.common.synchronization [req-e314b4de-3af8-4dc5-a6cc-b441a492a905 req-8af1c14a-42ab-4e17-bd97-31f80c4723e6 service nova] Enqueued Resource ID: 3cd8cf7d-5793-4464-821e-78828cb956a9 with Priority: HIGHEST for action security_group_rules [ 651.680582] env[69188]: INFO networking_nsxv3.common.synchronization [req-e314b4de-3af8-4dc5-a6cc-b441a492a905 req-8af1c14a-42ab-4e17-bd97-31f80c4723e6 service nova] Enqueued Resource ID: 3cd8cf7d-5793-4464-821e-78828cb956a9 with Priority: HIGHEST for action security_group_members [ 651.680704] env[69188]: INFO networking_nsxv3.common.synchronization [req-e314b4de-3af8-4dc5-a6cc-b441a492a905 req-8af1c14a-42ab-4e17-bd97-31f80c4723e6 service nova] Enqueued Resource ID: dcf8155c-ab4b-4fe2-9f4f-3809905255b3 with Priority: HIGHEST for action port [ 651.680890] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3cd8cf7d-5793-4464-821e-78828cb956a9 with Priority: HIGHEST for action security_group_rules [ 651.681307] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3cd8cf7d-5793-4464-821e-78828cb956a9 with Priority: HIGHEST for action security_group_members [ 651.681307] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dcf8155c-ab4b-4fe2-9f4f-3809905255b3 with Priority: HIGHEST for action port [ 651.681799] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3cd8cf7d-5793-4464-821e-78828cb956a9 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.682109] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3cd8cf7d-5793-4464-821e-78828cb956a9" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.682185] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3cd8cf7d-5793-4464-821e-78828cb956a9" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.682823] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3cd8cf7d-5793-4464-821e-78828cb956a9" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.682823] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3cd8cf7d-5793-4464-821e-78828cb956a9',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.687985] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-3cd8cf7d-5793-4464-821e-78828cb956a9 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.688132] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3cd8cf7d-5793-4464-821e-78828cb956a9" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.688257] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3cd8cf7d-5793-4464-821e-78828cb956a9" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.689076] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3cd8cf7d-5793-4464-821e-78828cb956a9" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.689076] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.689076] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.689076] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.689076] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.689076] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.689740] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3cd8cf7d-5793-4464-821e-78828cb956a9',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.690707] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-dcf8155c-ab4b-4fe2-9f4f-3809905255b3 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.690851] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dcf8155c-ab4b-4fe2-9f4f-3809905255b3" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.690851] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dcf8155c-ab4b-4fe2-9f4f-3809905255b3" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.691027] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dcf8155c-ab4b-4fe2-9f4f-3809905255b3" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.691107] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dcf8155c-ab4b-4fe2-9f4f-3809905255b3',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.692677] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4e9db3bb-e903-42d7-b7e6-e365ea0c7f5f: rpc.has_security_group_logging(os_id): False [ 651.710116] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.710320] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.710411] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.710656] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.710825] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.711449] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.711599] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.711662] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.711860] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.712042] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.712328] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.712409] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.712444] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.712686] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.712786] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.712984] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.713092] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.713213] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.713414] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.713528] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.713590] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4e9db3bb-e903-42d7-b7e6-e365ea0c7f5f is going to be created. [ 651.770452] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.771659] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.771836] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.772189] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.772468] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.784574] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4e9db3bb-e903-42d7-b7e6-e365ea0c7f5f in Status: IN_PROGRESS for 2s [ 651.824333] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.824866] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.824866] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.824866] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.824866] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.825431] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.825431] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.825431] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.825627] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.825627] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.825695] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 345a1564-5c47-4d81-9096-66a6ad96570a already deleted. [ 651.825775] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-345a1564-5c47-4d81-9096-66a6ad96570a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.016937] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-53b2b927-2e3d-4111-b25a-7b34ab9fa28d taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.016937] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-53b2b927-2e3d-4111-b25a-7b34ab9fa28d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.016937] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-53b2b927-2e3d-4111-b25a-7b34ab9fa28d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.016937] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-53b2b927-2e3d-4111-b25a-7b34ab9fa28d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.016937] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.016937] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.016937] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.016937] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.016937] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.016937] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-53b2b927-2e3d-4111-b25a-7b34ab9fa28d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.016937] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-53b2b927-2e3d-4111-b25a-7b34ab9fa28d taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.016937] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-53b2b927-2e3d-4111-b25a-7b34ab9fa28d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.016937] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-53b2b927-2e3d-4111-b25a-7b34ab9fa28d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.016937] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-53b2b927-2e3d-4111-b25a-7b34ab9fa28d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.016937] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.016937] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.017667] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.017667] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.017667] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.017667] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-53b2b927-2e3d-4111-b25a-7b34ab9fa28d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.017667] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('53b2b927-2e3d-4111-b25a-7b34ab9fa28d',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.189930] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-3cd8cf7d-5793-4464-821e-78828cb956a9 taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.190236] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3cd8cf7d-5793-4464-821e-78828cb956a9" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.194329] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3cd8cf7d-5793-4464-821e-78828cb956a9',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.195276] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port dcf8155c-ab4b-4fe2-9f4f-3809905255b3 with status ACTIVE [ 652.195469] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.195594] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.195659] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.195866] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.195951] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.196180] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.196281] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.196342] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.196496] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.196570] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.196747] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.196833] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.196887] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.197035] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.197111] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.197184] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: dcf8155c-ab4b-4fe2-9f4f-3809905255b3 is going to be updated. [ 652.224285] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.224465] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.224508] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.224698] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.225066] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.225236] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dcf8155c-ab4b-4fe2-9f4f-3809905255b3" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.327256] env[69188]: INFO networking_nsxv3.common.synchronization [None req-3390cad8-e51c-4c51-bcd6-28eff28f3543 None None] Enqueued Resource ID: 5832a07b-0977-4e52-9811-a71c479f1236 with Priority: HIGHEST for action port [ 652.327256] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5832a07b-0977-4e52-9811-a71c479f1236 with Priority: HIGHEST for action port [ 652.327462] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-5832a07b-0977-4e52-9811-a71c479f1236 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.327462] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5832a07b-0977-4e52-9811-a71c479f1236" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.327462] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5832a07b-0977-4e52-9811-a71c479f1236" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.327744] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5832a07b-0977-4e52-9811-a71c479f1236" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.327820] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5832a07b-0977-4e52-9811-a71c479f1236',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.519665] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 53b2b927-2e3d-4111-b25a-7b34ab9fa28d: rpc.has_security_group_logging(os_id): False [ 652.537411] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.537411] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.537411] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.537648] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.538068] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.538068] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.538210] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.538326] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.538848] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.538848] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.539278] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.539278] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.539386] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.539571] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.539920] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.540182] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.540325] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.540414] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.540612] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.540767] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.540834] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 53b2b927-2e3d-4111-b25a-7b34ab9fa28d is going to be created. [ 652.602935] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.605030] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.605030] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.605030] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.605564] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.617136] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 53b2b927-2e3d-4111-b25a-7b34ab9fa28d in Status: IN_PROGRESS for 2s [ 652.674908] env[69188]: INFO networking_nsxv3.common.synchronization [None req-91ee993d-0399-406e-9e80-70f202b8d8d3 None None] Enqueued Resource ID: 4fd7bd68-e4e2-4a1a-8d41-172d4e3f4bb6 with Priority: HIGHEST for action port [ 652.677336] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4fd7bd68-e4e2-4a1a-8d41-172d4e3f4bb6 with Priority: HIGHEST for action port [ 652.677809] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-4fd7bd68-e4e2-4a1a-8d41-172d4e3f4bb6 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.677809] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4fd7bd68-e4e2-4a1a-8d41-172d4e3f4bb6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.677955] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4fd7bd68-e4e2-4a1a-8d41-172d4e3f4bb6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.678226] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4fd7bd68-e4e2-4a1a-8d41-172d4e3f4bb6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.678303] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4fd7bd68-e4e2-4a1a-8d41-172d4e3f4bb6',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.704590] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3cd8cf7d-5793-4464-821e-78828cb956a9',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.739216] env[69188]: INFO networking_nsxv3.common.synchronization [None req-c15ce947-7154-4840-b6f5-b476d3ecfe73 None None] Enqueued Resource ID: c7a89ef8-858b-4432-918e-8e9490dd9020 with Priority: HIGHEST for action port [ 652.739216] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c7a89ef8-858b-4432-918e-8e9490dd9020 with Priority: HIGHEST for action port [ 652.739216] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-c7a89ef8-858b-4432-918e-8e9490dd9020 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.739216] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c7a89ef8-858b-4432-918e-8e9490dd9020" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.739216] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c7a89ef8-858b-4432-918e-8e9490dd9020" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.739216] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c7a89ef8-858b-4432-918e-8e9490dd9020" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.739216] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c7a89ef8-858b-4432-918e-8e9490dd9020',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.831483] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5832a07b-0977-4e52-9811-a71c479f1236 [ 652.831842] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.832061] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.832867] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.833176] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.833327] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.834749] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5832a07b-0977-4e52-9811-a71c479f1236 already deleted. [ 652.834913] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5832a07b-0977-4e52-9811-a71c479f1236" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.182022] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4fd7bd68-e4e2-4a1a-8d41-172d4e3f4bb6 [ 653.182022] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.182022] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.182022] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.182022] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.182022] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.182022] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4fd7bd68-e4e2-4a1a-8d41-172d4e3f4bb6 already deleted. [ 653.182022] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4fd7bd68-e4e2-4a1a-8d41-172d4e3f4bb6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.207812] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.209914] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.209914] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.209914] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.209914] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.212020] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3cd8cf7d-5793-4464-821e-78828cb956a9 is going to be created. [ 653.237275] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.237890] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.238145] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.238447] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.239087] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.242796] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c7a89ef8-858b-4432-918e-8e9490dd9020 [ 653.242796] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.242796] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.242796] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.242796] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.242796] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.242796] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c7a89ef8-858b-4432-918e-8e9490dd9020 already deleted. [ 653.242796] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c7a89ef8-858b-4432-918e-8e9490dd9020" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.250679] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3cd8cf7d-5793-4464-821e-78828cb956a9 in Status: UNINITIALIZED for 2s [ 653.588268] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock network-267 taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.588949] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "network-267" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.589177] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "network-267" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.589569] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "network-267" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.589947] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.590095] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.590167] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.590755] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.590755] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.590878] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 653.590930] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] NeedRegenerationException {{(pid=69188) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 653.591068] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] no value, waiting for create lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 653.591189] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] value creation lock acquired {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 653.593022] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 653.593022] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Calling creation function for not-yet-present value {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 653.593022] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 653.614804] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 653.614804] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69188) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 653.614804] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Released creation lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 653.614804] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "network-267" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.614804] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock port-4491abce-8bb6-45c4-8100-85d4e9ca90a3 taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.614804] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "port-4491abce-8bb6-45c4-8100-85d4e9ca90a3" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.614804] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "port-4491abce-8bb6-45c4-8100-85d4e9ca90a3" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.614804] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "port-4491abce-8bb6-45c4-8100-85d4e9ca90a3" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.614804] env[69188]: DEBUG networking_nsxv3.api.rpc [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4491abce-8bb6-45c4-8100-85d4e9ca90a3',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.743990] env[69188]: INFO networking_nsxv3.common.synchronization [req-6b1394c6-6191-4f0d-a10a-bf8e6b8c8d93 req-e5037e69-47f5-446a-8433-f8f168dd3b77 tempest-ServersWithSpecificFlavorTestJSON-1359499520 tempest-ServersWithSpecificFlavorTestJSON-1359499520-project-member] Enqueued Resource ID: ec45d27b-caa2-4488-8317-d6595de404b8 with Priority: HIGHEST for action security_group_members [ 653.744608] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ec45d27b-caa2-4488-8317-d6595de404b8 with Priority: HIGHEST for action security_group_members [ 653.745789] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-ec45d27b-caa2-4488-8317-d6595de404b8 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.746049] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ec45d27b-caa2-4488-8317-d6595de404b8" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.746396] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ec45d27b-caa2-4488-8317-d6595de404b8" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.746684] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ec45d27b-caa2-4488-8317-d6595de404b8" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.746855] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.746970] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.747059] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.747227] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.747316] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.747412] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ec45d27b-caa2-4488-8317-d6595de404b8',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.802385] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4e9db3bb-e903-42d7-b7e6-e365ea0c7f5f in Status: SUCCESS [ 653.802385] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4e9db3bb-e903-42d7-b7e6-e365ea0c7f5f" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.100111] env[69188]: INFO networking_nsxv3.common.synchronization [None req-c74587be-e55a-4526-86d0-1c137a070384 tempest-VolumesAdminNegativeTest-627287247 tempest-VolumesAdminNegativeTest-627287247-project-member] Enqueued Resource ID: cd207b0a-02a6-4378-9240-c9d49160b653 with Priority: HIGHEST for action security_group_rules [ 654.100685] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cd207b0a-02a6-4378-9240-c9d49160b653 with Priority: HIGHEST for action security_group_rules [ 654.101090] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cd207b0a-02a6-4378-9240-c9d49160b653 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.101274] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cd207b0a-02a6-4378-9240-c9d49160b653" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.101345] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cd207b0a-02a6-4378-9240-c9d49160b653" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.101841] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cd207b0a-02a6-4378-9240-c9d49160b653" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.101841] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cd207b0a-02a6-4378-9240-c9d49160b653',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.119234] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.119234] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.119234] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.119234] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.119234] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.119234] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Segment Port 4491abce-8bb6-45c4-8100-85d4e9ca90a3 not found, creating... [ 654.119981] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.119981] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.119981] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.120114] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.120252] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.120475] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.120619] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.120752] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.120937] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.121086] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.121233] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Resource: SegmentPort with ID: 4491abce-8bb6-45c4-8100-85d4e9ca90a3 is going to be created. [ 654.143057] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.144415] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.144415] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.144415] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.144415] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.144415] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "port-4491abce-8bb6-45c4-8100-85d4e9ca90a3" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.250376] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.250632] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.252411] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.252703] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.252801] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.253072] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.253253] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.253331] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.253478] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.253555] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.253645] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ec45d27b-caa2-4488-8317-d6595de404b8 already deleted. [ 654.253724] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ec45d27b-caa2-4488-8317-d6595de404b8" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.585620] env[69188]: INFO networking_nsxv3.common.synchronization [None req-e68aeec1-f274-4868-830b-eb3fb0bd9a2e tempest-VolumesAdminNegativeTest-627287247 tempest-VolumesAdminNegativeTest-627287247-project-member] Enqueued Resource ID: cd207b0a-02a6-4378-9240-c9d49160b653 with Priority: HIGHEST for action security_group_rules [ 654.586561] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cd207b0a-02a6-4378-9240-c9d49160b653 with Priority: HIGHEST for action security_group_rules [ 654.587090] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cd207b0a-02a6-4378-9240-c9d49160b653 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.587288] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cd207b0a-02a6-4378-9240-c9d49160b653" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.627082] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.627955] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.628076] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.628382] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.628515] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.628582] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cd207b0a-02a6-4378-9240-c9d49160b653 already deleted. [ 654.628665] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cd207b0a-02a6-4378-9240-c9d49160b653" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.629396] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cd207b0a-02a6-4378-9240-c9d49160b653" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.629656] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cd207b0a-02a6-4378-9240-c9d49160b653" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.629789] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cd207b0a-02a6-4378-9240-c9d49160b653',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.632604] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 53b2b927-2e3d-4111-b25a-7b34ab9fa28d in Status: SUCCESS [ 654.632816] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-53b2b927-2e3d-4111-b25a-7b34ab9fa28d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.151365] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.151573] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.152327] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.152650] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.152754] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.152850] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cd207b0a-02a6-4378-9240-c9d49160b653 already deleted. [ 655.152939] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cd207b0a-02a6-4378-9240-c9d49160b653" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.204308] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock network-603 taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.204786] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "network-603" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.204786] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "network-603" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.205014] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "network-603" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.209495] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.211839] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.211839] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.212099] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.212261] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.212484] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 655.213035] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] NeedRegenerationException {{(pid=69188) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 655.213035] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] no value, waiting for create lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 655.213035] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] value creation lock acquired {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 655.213035] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 655.214496] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Calling creation function for not-yet-present value {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 655.214496] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 655.237790] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 655.237790] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69188) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 655.237790] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Released creation lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 655.237790] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "network-603" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.237790] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock port-e021dd53-94b3-418d-bcc3-8489261d7227 taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.237790] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "port-e021dd53-94b3-418d-bcc3-8489261d7227" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.237790] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "port-e021dd53-94b3-418d-bcc3-8489261d7227" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.239400] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "port-e021dd53-94b3-418d-bcc3-8489261d7227" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.239400] env[69188]: DEBUG networking_nsxv3.api.rpc [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e021dd53-94b3-418d-bcc3-8489261d7227',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.259134] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3cd8cf7d-5793-4464-821e-78828cb956a9 in Status: SUCCESS [ 655.259551] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3cd8cf7d-5793-4464-821e-78828cb956a9" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.260161] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3cd8cf7d-5793-4464-821e-78828cb956a9" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.260374] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3cd8cf7d-5793-4464-821e-78828cb956a9" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.260703] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.260812] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.260889] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.262412] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.262412] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.262412] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3cd8cf7d-5793-4464-821e-78828cb956a9" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.263109] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3cd8cf7d-5793-4464-821e-78828cb956a9',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.352491] env[69188]: INFO networking_nsxv3.common.synchronization [None req-6bb516dd-27fd-4266-b1b9-d7b2f9fc7eca None None] Enqueued Resource ID: e759cecb-d7db-45c4-9882-9ec2d9186848 with Priority: HIGHEST for action port [ 655.352491] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e759cecb-d7db-45c4-9882-9ec2d9186848 with Priority: HIGHEST for action port [ 655.352800] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-e759cecb-d7db-45c4-9882-9ec2d9186848 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.352800] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e759cecb-d7db-45c4-9882-9ec2d9186848" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.352896] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e759cecb-d7db-45c4-9882-9ec2d9186848" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.354793] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e759cecb-d7db-45c4-9882-9ec2d9186848" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.354793] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e759cecb-d7db-45c4-9882-9ec2d9186848',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.434104] env[69188]: INFO networking_nsxv3.common.synchronization [req-7fe6ef7a-e9d8-4a96-a93d-f95c3ab279b4 req-9c3bec3d-b085-4431-8c44-946a33c8f3f0 service nova] Enqueued Resource ID: 345a1564-5c47-4d81-9096-66a6ad96570a with Priority: HIGHEST for action security_group_rules [ 655.434424] env[69188]: INFO networking_nsxv3.common.synchronization [req-7fe6ef7a-e9d8-4a96-a93d-f95c3ab279b4 req-9c3bec3d-b085-4431-8c44-946a33c8f3f0 service nova] Enqueued Resource ID: 345a1564-5c47-4d81-9096-66a6ad96570a with Priority: HIGHEST for action security_group_members [ 655.434591] env[69188]: INFO networking_nsxv3.common.synchronization [req-7fe6ef7a-e9d8-4a96-a93d-f95c3ab279b4 req-9c3bec3d-b085-4431-8c44-946a33c8f3f0 service nova] Enqueued Resource ID: 4491abce-8bb6-45c4-8100-85d4e9ca90a3 with Priority: HIGHEST for action port [ 655.434839] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 345a1564-5c47-4d81-9096-66a6ad96570a with Priority: HIGHEST for action security_group_rules [ 655.434968] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 345a1564-5c47-4d81-9096-66a6ad96570a with Priority: HIGHEST for action security_group_members [ 655.435081] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4491abce-8bb6-45c4-8100-85d4e9ca90a3 with Priority: HIGHEST for action port [ 655.435626] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-345a1564-5c47-4d81-9096-66a6ad96570a taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.436388] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-345a1564-5c47-4d81-9096-66a6ad96570a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.436388] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-345a1564-5c47-4d81-9096-66a6ad96570a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.441893] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-345a1564-5c47-4d81-9096-66a6ad96570a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.442447] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('345a1564-5c47-4d81-9096-66a6ad96570a',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.446586] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-345a1564-5c47-4d81-9096-66a6ad96570a taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.446724] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-345a1564-5c47-4d81-9096-66a6ad96570a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.446796] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-345a1564-5c47-4d81-9096-66a6ad96570a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.447016] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-345a1564-5c47-4d81-9096-66a6ad96570a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.447193] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.447298] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.447361] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.447517] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.447604] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.447700] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('345a1564-5c47-4d81-9096-66a6ad96570a',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.450453] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-4491abce-8bb6-45c4-8100-85d4e9ca90a3 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.450453] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4491abce-8bb6-45c4-8100-85d4e9ca90a3" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.450742] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4491abce-8bb6-45c4-8100-85d4e9ca90a3" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.450952] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4491abce-8bb6-45c4-8100-85d4e9ca90a3" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.451052] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4491abce-8bb6-45c4-8100-85d4e9ca90a3',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.459024] env[69188]: INFO networking_nsxv3.common.synchronization [None req-a13b8a8b-9565-4420-a252-725ba5da8a53 None None] Enqueued Resource ID: 6521d3ae-ba78-4a97-bbc7-a8fb768e7f0c with Priority: HIGHEST for action port [ 655.460947] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6521d3ae-ba78-4a97-bbc7-a8fb768e7f0c with Priority: HIGHEST for action port [ 655.460947] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-6521d3ae-ba78-4a97-bbc7-a8fb768e7f0c taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.460947] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6521d3ae-ba78-4a97-bbc7-a8fb768e7f0c" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.460947] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6521d3ae-ba78-4a97-bbc7-a8fb768e7f0c" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.461995] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6521d3ae-ba78-4a97-bbc7-a8fb768e7f0c" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.461995] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6521d3ae-ba78-4a97-bbc7-a8fb768e7f0c',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.743236] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.743236] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.743236] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.743236] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.743236] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.743236] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Segment Port e021dd53-94b3-418d-bcc3-8489261d7227 not found, creating... [ 655.743479] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.743648] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.743801] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.743948] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.744105] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.744474] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.744580] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.744678] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.746237] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.746237] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.746237] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Resource: SegmentPort with ID: e021dd53-94b3-418d-bcc3-8489261d7227 is going to be created. [ 655.766366] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3cd8cf7d-5793-4464-821e-78828cb956a9',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.768658] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.769177] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.769575] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.770043] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.770317] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.770626] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "port-e021dd53-94b3-418d-bcc3-8489261d7227" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.859298] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e759cecb-d7db-45c4-9882-9ec2d9186848 [ 655.859298] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.859298] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.859298] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.859298] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.859298] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.859298] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e759cecb-d7db-45c4-9882-9ec2d9186848 already deleted. [ 655.859298] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e759cecb-d7db-45c4-9882-9ec2d9186848" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.953724] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-345a1564-5c47-4d81-9096-66a6ad96570a taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.955479] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-345a1564-5c47-4d81-9096-66a6ad96570a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.955479] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4491abce-8bb6-45c4-8100-85d4e9ca90a3 with status ACTIVE [ 655.955479] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.955479] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.955479] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.955479] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.955479] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.955479] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.958437] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.958437] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.958437] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.958437] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.958437] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.958437] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.958437] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.958437] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.958437] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.958437] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4491abce-8bb6-45c4-8100-85d4e9ca90a3 is going to be updated. [ 655.958437] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('345a1564-5c47-4d81-9096-66a6ad96570a',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.964376] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6521d3ae-ba78-4a97-bbc7-a8fb768e7f0c [ 655.964376] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.964376] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.967470] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.967470] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.967470] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.967470] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6521d3ae-ba78-4a97-bbc7-a8fb768e7f0c already deleted. [ 655.967470] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6521d3ae-ba78-4a97-bbc7-a8fb768e7f0c" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.992632] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.992632] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.992886] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.996459] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.996459] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.996872] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4491abce-8bb6-45c4-8100-85d4e9ca90a3" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.273354] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3cd8cf7d-5793-4464-821e-78828cb956a9: rpc.has_security_group_logging(os_id): False [ 656.300976] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.300976] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.300976] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.300976] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.300976] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.300976] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.300976] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.300976] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.301324] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.301501] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.301501] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3cd8cf7d-5793-4464-821e-78828cb956a9 is going to be created. [ 656.305444] env[69188]: INFO networking_nsxv3.common.synchronization [None req-92ec620c-c883-4593-9f48-76c065e965fc None None] Enqueued Resource ID: 730f2d95-686c-412f-8b6e-aacadacd3427 with Priority: HIGHEST for action port [ 656.305946] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 730f2d95-686c-412f-8b6e-aacadacd3427 with Priority: HIGHEST for action port [ 656.308518] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-730f2d95-686c-412f-8b6e-aacadacd3427 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.308518] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-730f2d95-686c-412f-8b6e-aacadacd3427" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.308518] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-730f2d95-686c-412f-8b6e-aacadacd3427" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.308884] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-730f2d95-686c-412f-8b6e-aacadacd3427" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.308923] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('730f2d95-686c-412f-8b6e-aacadacd3427',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.363715] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.363715] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.363715] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.363715] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.363715] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.377900] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3cd8cf7d-5793-4464-821e-78828cb956a9 in Status: IN_PROGRESS for 2s [ 656.465826] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('345a1564-5c47-4d81-9096-66a6ad96570a',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.812402] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 730f2d95-686c-412f-8b6e-aacadacd3427 [ 656.812637] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.812783] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.812853] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.813073] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.813161] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.813257] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:730f2d95-686c-412f-8b6e-aacadacd3427 already deleted. [ 656.813338] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-730f2d95-686c-412f-8b6e-aacadacd3427" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.968868] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.968983] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.969084] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.970180] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.970180] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.970180] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 345a1564-5c47-4d81-9096-66a6ad96570a is going to be created. [ 656.992940] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.993114] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.993187] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.993405] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.993576] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.002895] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 345a1564-5c47-4d81-9096-66a6ad96570a in Status: UNINITIALIZED for 2s [ 657.046492] env[69188]: INFO networking_nsxv3.common.synchronization [req-a4caa883-ac7f-4c97-a9dd-3ea178c2e676 req-87fc4258-3971-4708-a9fa-587b69284e8f tempest-FloatingIPsAssociationNegativeTestJSON-127533384 tempest-FloatingIPsAssociationNegativeTestJSON-127533384-project-member] Enqueued Resource ID: 5ad89469-8ec8-4f86-aa6c-a6f4c7596c0b with Priority: HIGHEST for action security_group_members [ 657.046492] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5ad89469-8ec8-4f86-aa6c-a6f4c7596c0b with Priority: HIGHEST for action security_group_members [ 657.046492] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-5ad89469-8ec8-4f86-aa6c-a6f4c7596c0b taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.046492] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5ad89469-8ec8-4f86-aa6c-a6f4c7596c0b" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.046492] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5ad89469-8ec8-4f86-aa6c-a6f4c7596c0b" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.046492] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5ad89469-8ec8-4f86-aa6c-a6f4c7596c0b" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.046492] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.046492] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.046492] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.046492] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.046492] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.046492] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5ad89469-8ec8-4f86-aa6c-a6f4c7596c0b',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.550022] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.550022] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.550022] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.550022] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.550022] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.550577] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.550577] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.550577] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.550737] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.550778] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.551026] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5ad89469-8ec8-4f86-aa6c-a6f4c7596c0b is going to be updated. [ 657.577963] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.582354] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.582354] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.582354] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.582354] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.597216] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5ad89469-8ec8-4f86-aa6c-a6f4c7596c0b in Status: IN_PROGRESS for 2s [ 657.979131] env[69188]: INFO networking_nsxv3.common.synchronization [req-6b1394c6-6191-4f0d-a10a-bf8e6b8c8d93 req-b3d74d1f-1cef-477f-8dea-3a52ae1b19a0 service nova] Enqueued Resource ID: ec45d27b-caa2-4488-8317-d6595de404b8 with Priority: HIGHEST for action security_group_rules [ 657.980727] env[69188]: INFO networking_nsxv3.common.synchronization [req-6b1394c6-6191-4f0d-a10a-bf8e6b8c8d93 req-b3d74d1f-1cef-477f-8dea-3a52ae1b19a0 service nova] Enqueued Resource ID: ec45d27b-caa2-4488-8317-d6595de404b8 with Priority: HIGHEST for action security_group_members [ 657.980727] env[69188]: INFO networking_nsxv3.common.synchronization [req-6b1394c6-6191-4f0d-a10a-bf8e6b8c8d93 req-b3d74d1f-1cef-477f-8dea-3a52ae1b19a0 service nova] Enqueued Resource ID: e021dd53-94b3-418d-bcc3-8489261d7227 with Priority: HIGHEST for action port [ 657.980727] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ec45d27b-caa2-4488-8317-d6595de404b8 with Priority: HIGHEST for action security_group_rules [ 657.980727] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ec45d27b-caa2-4488-8317-d6595de404b8 with Priority: HIGHEST for action security_group_members [ 657.980727] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e021dd53-94b3-418d-bcc3-8489261d7227 with Priority: HIGHEST for action port [ 657.981245] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ec45d27b-caa2-4488-8317-d6595de404b8 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.981245] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ec45d27b-caa2-4488-8317-d6595de404b8" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.981245] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ec45d27b-caa2-4488-8317-d6595de404b8" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.981355] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ec45d27b-caa2-4488-8317-d6595de404b8" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.981718] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ec45d27b-caa2-4488-8317-d6595de404b8',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.982377] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-ec45d27b-caa2-4488-8317-d6595de404b8 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.982377] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ec45d27b-caa2-4488-8317-d6595de404b8" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.982591] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ec45d27b-caa2-4488-8317-d6595de404b8" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.983333] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ec45d27b-caa2-4488-8317-d6595de404b8" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.983333] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.983333] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.983333] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.983333] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.983333] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.983333] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ec45d27b-caa2-4488-8317-d6595de404b8',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.984435] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-e021dd53-94b3-418d-bcc3-8489261d7227 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.984541] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e021dd53-94b3-418d-bcc3-8489261d7227" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.984681] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e021dd53-94b3-418d-bcc3-8489261d7227" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.984835] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e021dd53-94b3-418d-bcc3-8489261d7227" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.984901] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e021dd53-94b3-418d-bcc3-8489261d7227',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.329741] env[69188]: INFO networking_nsxv3.common.synchronization [None req-5da37efa-1fbb-42da-804a-00542d817f43 None None] Enqueued Resource ID: 4919ae5a-4d44-4e3a-a4da-f907b6605b4e with Priority: HIGHEST for action port [ 658.330313] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4919ae5a-4d44-4e3a-a4da-f907b6605b4e with Priority: HIGHEST for action port [ 658.330915] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-4919ae5a-4d44-4e3a-a4da-f907b6605b4e taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.331901] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4919ae5a-4d44-4e3a-a4da-f907b6605b4e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.331901] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4919ae5a-4d44-4e3a-a4da-f907b6605b4e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.335273] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4919ae5a-4d44-4e3a-a4da-f907b6605b4e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.335349] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4919ae5a-4d44-4e3a-a4da-f907b6605b4e',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.388125] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3cd8cf7d-5793-4464-821e-78828cb956a9 in Status: SUCCESS [ 658.388361] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3cd8cf7d-5793-4464-821e-78828cb956a9" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.486898] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-ec45d27b-caa2-4488-8317-d6595de404b8 taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.487159] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ec45d27b-caa2-4488-8317-d6595de404b8" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.489052] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ec45d27b-caa2-4488-8317-d6595de404b8',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.489052] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e021dd53-94b3-418d-bcc3-8489261d7227 with status ACTIVE [ 658.489052] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.489052] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.489052] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.489052] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.489052] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.489673] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.489673] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.489673] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.489673] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.489673] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.489962] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.490039] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.490646] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.490646] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.490646] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.490646] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e021dd53-94b3-418d-bcc3-8489261d7227 is going to be updated. [ 658.512857] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.513121] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.513121] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.513433] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.513703] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.513906] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e021dd53-94b3-418d-bcc3-8489261d7227" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.837900] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4919ae5a-4d44-4e3a-a4da-f907b6605b4e [ 658.838183] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.838307] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.838376] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.838625] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.838719] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.838817] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4919ae5a-4d44-4e3a-a4da-f907b6605b4e already deleted. [ 658.838900] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4919ae5a-4d44-4e3a-a4da-f907b6605b4e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.995137] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ec45d27b-caa2-4488-8317-d6595de404b8',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.009073] env[69188]: INFO networking_nsxv3.common.synchronization [None req-f916f280-f92a-4faa-a318-36f3d1cc696e None None] Enqueued Resource ID: 1576be26-35b7-4a75-b783-dc6889fbdd46 with Priority: HIGHEST for action port [ 659.009959] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1576be26-35b7-4a75-b783-dc6889fbdd46 with Priority: HIGHEST for action port [ 659.010410] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-1576be26-35b7-4a75-b783-dc6889fbdd46 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.010592] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1576be26-35b7-4a75-b783-dc6889fbdd46" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.010664] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1576be26-35b7-4a75-b783-dc6889fbdd46" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.011032] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1576be26-35b7-4a75-b783-dc6889fbdd46" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.011116] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1576be26-35b7-4a75-b783-dc6889fbdd46',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.013705] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 345a1564-5c47-4d81-9096-66a6ad96570a in Status: SUCCESS [ 659.013912] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-345a1564-5c47-4d81-9096-66a6ad96570a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.014092] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-345a1564-5c47-4d81-9096-66a6ad96570a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.014297] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-345a1564-5c47-4d81-9096-66a6ad96570a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.014481] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.014612] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.014679] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.014845] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.015162] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.015162] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-345a1564-5c47-4d81-9096-66a6ad96570a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.015254] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('345a1564-5c47-4d81-9096-66a6ad96570a',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.497584] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.498041] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.498041] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.498041] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.498854] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.498854] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ec45d27b-caa2-4488-8317-d6595de404b8 is going to be created. [ 659.517027] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1576be26-35b7-4a75-b783-dc6889fbdd46 [ 659.517807] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.517807] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.517807] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.517807] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.517807] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.518079] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1576be26-35b7-4a75-b783-dc6889fbdd46 already deleted. [ 659.518079] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1576be26-35b7-4a75-b783-dc6889fbdd46" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.519190] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-345a1564-5c47-4d81-9096-66a6ad96570a taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.519190] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-345a1564-5c47-4d81-9096-66a6ad96570a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.519190] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-345a1564-5c47-4d81-9096-66a6ad96570a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.519190] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-345a1564-5c47-4d81-9096-66a6ad96570a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.519190] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.519190] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.519190] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.519190] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.519190] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.519190] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-345a1564-5c47-4d81-9096-66a6ad96570a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.519782] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-345a1564-5c47-4d81-9096-66a6ad96570a taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.519782] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-345a1564-5c47-4d81-9096-66a6ad96570a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.519782] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-345a1564-5c47-4d81-9096-66a6ad96570a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.519782] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-345a1564-5c47-4d81-9096-66a6ad96570a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.519782] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.519782] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.519981] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.519981] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.521147] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.521687] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-345a1564-5c47-4d81-9096-66a6ad96570a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.521687] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('345a1564-5c47-4d81-9096-66a6ad96570a',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.522996] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.523715] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.523715] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.523715] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.523855] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.533276] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ec45d27b-caa2-4488-8317-d6595de404b8 in Status: UNINITIALIZED for 2s [ 659.611565] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5ad89469-8ec8-4f86-aa6c-a6f4c7596c0b in Status: SUCCESS [ 659.611565] env[69188]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5ad89469-8ec8-4f86-aa6c-a6f4c7596c0b deletion is rescheduled due to dependency. [ 659.611565] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5ad89469-8ec8-4f86-aa6c-a6f4c7596c0b" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.729956] env[69188]: INFO networking_nsxv3.common.synchronization [None req-dd103b8d-8fe6-46c2-9d3b-b1f79389a919 None None] Enqueued Resource ID: f1a5b4aa-a9aa-47ec-8d53-c37adcc9f648 with Priority: HIGHEST for action port [ 659.730209] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f1a5b4aa-a9aa-47ec-8d53-c37adcc9f648 with Priority: HIGHEST for action port [ 659.731057] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-f1a5b4aa-a9aa-47ec-8d53-c37adcc9f648 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.731225] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f1a5b4aa-a9aa-47ec-8d53-c37adcc9f648" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.731292] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f1a5b4aa-a9aa-47ec-8d53-c37adcc9f648" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.731547] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f1a5b4aa-a9aa-47ec-8d53-c37adcc9f648" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.731951] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f1a5b4aa-a9aa-47ec-8d53-c37adcc9f648',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.027135] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 345a1564-5c47-4d81-9096-66a6ad96570a: rpc.has_security_group_logging(os_id): False [ 660.045063] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.045063] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.045063] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.045241] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.045353] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.045581] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.045704] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.045774] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.045940] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.046027] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.046244] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.046386] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.046452] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.047367] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.047570] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.047801] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.047919] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.048011] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.048223] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.048321] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.048438] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 345a1564-5c47-4d81-9096-66a6ad96570a is going to be created. [ 660.101673] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.101853] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.101929] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.102238] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.102441] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.114038] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 345a1564-5c47-4d81-9096-66a6ad96570a in Status: IN_PROGRESS for 2s [ 660.238624] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f1a5b4aa-a9aa-47ec-8d53-c37adcc9f648 [ 660.238882] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.239009] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.239086] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.239301] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.239380] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.239580] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f1a5b4aa-a9aa-47ec-8d53-c37adcc9f648 already deleted. [ 660.239580] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f1a5b4aa-a9aa-47ec-8d53-c37adcc9f648" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.554132] env[69188]: INFO networking_nsxv3.common.synchronization [None req-8a691a9a-34a3-423e-b3d2-281616dab603 None None] Enqueued Resource ID: 710bca4c-0847-4f90-93b3-8d9d7b78037a with Priority: HIGHEST for action port [ 660.554132] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 710bca4c-0847-4f90-93b3-8d9d7b78037a with Priority: HIGHEST for action port [ 660.554132] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-710bca4c-0847-4f90-93b3-8d9d7b78037a taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.554132] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-710bca4c-0847-4f90-93b3-8d9d7b78037a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.554132] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-710bca4c-0847-4f90-93b3-8d9d7b78037a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.554132] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-710bca4c-0847-4f90-93b3-8d9d7b78037a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.554132] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('710bca4c-0847-4f90-93b3-8d9d7b78037a',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.059228] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 710bca4c-0847-4f90-93b3-8d9d7b78037a [ 661.060678] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.060678] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.060678] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.060678] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.060678] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.060678] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:710bca4c-0847-4f90-93b3-8d9d7b78037a already deleted. [ 661.060678] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-710bca4c-0847-4f90-93b3-8d9d7b78037a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.547106] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ec45d27b-caa2-4488-8317-d6595de404b8 in Status: SUCCESS [ 661.547341] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ec45d27b-caa2-4488-8317-d6595de404b8" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.547663] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ec45d27b-caa2-4488-8317-d6595de404b8" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.547882] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ec45d27b-caa2-4488-8317-d6595de404b8" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.548090] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.548211] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.548274] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.548424] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.548503] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.548584] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ec45d27b-caa2-4488-8317-d6595de404b8" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.548671] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ec45d27b-caa2-4488-8317-d6595de404b8',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.551874] env[69188]: INFO networking_nsxv3.common.synchronization [None req-1900c0e4-8248-4d6a-87a3-4f6cf0f3b311 None None] Enqueued Resource ID: e66b85de-0df5-40b1-863b-66ced2660011 with Priority: HIGHEST for action port [ 661.552480] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e66b85de-0df5-40b1-863b-66ced2660011 with Priority: HIGHEST for action port [ 661.553158] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-e66b85de-0df5-40b1-863b-66ced2660011 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.553260] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e66b85de-0df5-40b1-863b-66ced2660011" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.553480] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e66b85de-0df5-40b1-863b-66ced2660011" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.554392] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e66b85de-0df5-40b1-863b-66ced2660011" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.554503] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e66b85de-0df5-40b1-863b-66ced2660011',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.023138] env[69188]: INFO networking_nsxv3.common.synchronization [None req-0d286759-d438-4830-9391-f848a675d177 None None] Enqueued Resource ID: 3be7ae54-c4de-4296-98c9-75b935983e6b with Priority: HIGHEST for action port [ 662.024163] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3be7ae54-c4de-4296-98c9-75b935983e6b with Priority: HIGHEST for action port [ 662.024497] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-3be7ae54-c4de-4296-98c9-75b935983e6b taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.025288] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3be7ae54-c4de-4296-98c9-75b935983e6b" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.025510] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3be7ae54-c4de-4296-98c9-75b935983e6b" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.025836] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3be7ae54-c4de-4296-98c9-75b935983e6b" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.026279] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3be7ae54-c4de-4296-98c9-75b935983e6b',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.054984] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ec45d27b-caa2-4488-8317-d6595de404b8',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.056808] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e66b85de-0df5-40b1-863b-66ced2660011 [ 662.056808] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.056808] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.056808] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.056808] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.058349] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.058349] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e66b85de-0df5-40b1-863b-66ced2660011 already deleted. [ 662.058349] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e66b85de-0df5-40b1-863b-66ced2660011" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.126864] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 345a1564-5c47-4d81-9096-66a6ad96570a in Status: SUCCESS [ 662.127257] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-345a1564-5c47-4d81-9096-66a6ad96570a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.529365] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3be7ae54-c4de-4296-98c9-75b935983e6b [ 662.530656] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.530656] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.530656] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.530656] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.530656] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.530656] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3be7ae54-c4de-4296-98c9-75b935983e6b already deleted. [ 662.530656] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3be7ae54-c4de-4296-98c9-75b935983e6b" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.560776] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ec45d27b-caa2-4488-8317-d6595de404b8: rpc.has_security_group_logging(os_id): False [ 662.578826] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.579027] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.579674] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.580063] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.580163] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.580420] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.580546] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.580599] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.580735] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.580810] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.580896] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ec45d27b-caa2-4488-8317-d6595de404b8 is going to be created. [ 662.640940] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.641907] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.641907] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.641907] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.641907] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.651957] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ec45d27b-caa2-4488-8317-d6595de404b8 in Status: IN_PROGRESS for 2s [ 662.864997] env[69188]: INFO networking_nsxv3.common.synchronization [req-b1578de8-bae0-4201-b3f5-439eb261f03f req-21baec68-3b90-4557-895c-1cebde7adc76 tempest-ServerExternalEventsTest-1851765045 tempest-ServerExternalEventsTest-1851765045-project-member] Enqueued Resource ID: 4e9db3bb-e903-42d7-b7e6-e365ea0c7f5f with Priority: HIGHEST for action security_group_members [ 662.865879] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e9db3bb-e903-42d7-b7e6-e365ea0c7f5f with Priority: HIGHEST for action security_group_members [ 662.866193] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-4e9db3bb-e903-42d7-b7e6-e365ea0c7f5f taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.866348] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4e9db3bb-e903-42d7-b7e6-e365ea0c7f5f" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.866853] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4e9db3bb-e903-42d7-b7e6-e365ea0c7f5f" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.866853] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4e9db3bb-e903-42d7-b7e6-e365ea0c7f5f" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.867086] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.867775] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.867775] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.867775] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.867775] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.867775] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4e9db3bb-e903-42d7-b7e6-e365ea0c7f5f',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.272987] env[69188]: INFO networking_nsxv3.common.synchronization [None req-c9591d9e-5c57-414a-a4c8-51c5455921dc None None] Enqueued Resource ID: 6c1c7f67-eb5f-4d4d-96c8-c221bde09825 with Priority: HIGHEST for action port [ 663.272987] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6c1c7f67-eb5f-4d4d-96c8-c221bde09825 with Priority: HIGHEST for action port [ 663.273611] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-6c1c7f67-eb5f-4d4d-96c8-c221bde09825 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.273611] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6c1c7f67-eb5f-4d4d-96c8-c221bde09825" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.273611] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6c1c7f67-eb5f-4d4d-96c8-c221bde09825" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.274330] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6c1c7f67-eb5f-4d4d-96c8-c221bde09825" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.274330] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6c1c7f67-eb5f-4d4d-96c8-c221bde09825',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.374845] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.374976] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.374976] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.377080] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.377080] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.377080] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.377080] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.377080] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.377080] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.377080] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.377080] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4e9db3bb-e903-42d7-b7e6-e365ea0c7f5f is going to be updated. [ 663.406135] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.408278] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.408278] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.408278] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.408278] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.416119] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4e9db3bb-e903-42d7-b7e6-e365ea0c7f5f in Status: IN_PROGRESS for 2s [ 663.777603] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6c1c7f67-eb5f-4d4d-96c8-c221bde09825 [ 663.778087] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.778087] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.778087] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.778276] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.778375] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.778661] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6c1c7f67-eb5f-4d4d-96c8-c221bde09825 already deleted. [ 663.778661] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6c1c7f67-eb5f-4d4d-96c8-c221bde09825" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.541975] env[69188]: INFO networking_nsxv3.common.synchronization [None req-fffebca5-1ab5-4dbc-8735-20ee6dfcc047 tempest-ServersTestFqdnHostnames-463327493 tempest-ServersTestFqdnHostnames-463327493-project-member] Enqueued Resource ID: 43255fe7-9062-49a0-a8ff-2aab46177272 with Priority: HIGHEST for action security_group_rules [ 664.542796] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 43255fe7-9062-49a0-a8ff-2aab46177272 with Priority: HIGHEST for action security_group_rules [ 664.547197] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-43255fe7-9062-49a0-a8ff-2aab46177272 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.547197] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-43255fe7-9062-49a0-a8ff-2aab46177272" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.547197] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-43255fe7-9062-49a0-a8ff-2aab46177272" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.547197] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-43255fe7-9062-49a0-a8ff-2aab46177272" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.547197] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('43255fe7-9062-49a0-a8ff-2aab46177272',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.663731] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ec45d27b-caa2-4488-8317-d6595de404b8 in Status: SUCCESS [ 664.664056] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ec45d27b-caa2-4488-8317-d6595de404b8" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.669376] env[69188]: INFO networking_nsxv3.common.synchronization [None req-d0205257-359e-4a2d-952f-aeaaa2167fe7 None None] Enqueued Resource ID: 68c1ee4d-5f5e-423f-b6c3-cf07470f2258 with Priority: HIGHEST for action port [ 664.669907] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 68c1ee4d-5f5e-423f-b6c3-cf07470f2258 with Priority: HIGHEST for action port [ 664.670142] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-68c1ee4d-5f5e-423f-b6c3-cf07470f2258 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.670293] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-68c1ee4d-5f5e-423f-b6c3-cf07470f2258" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.670360] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-68c1ee4d-5f5e-423f-b6c3-cf07470f2258" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.670800] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-68c1ee4d-5f5e-423f-b6c3-cf07470f2258" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.670800] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('68c1ee4d-5f5e-423f-b6c3-cf07470f2258',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.852360] env[69188]: INFO networking_nsxv3.common.synchronization [None req-6b64091b-325f-4aec-83d7-10f2d67fac88 tempest-ServersTestFqdnHostnames-463327493 tempest-ServersTestFqdnHostnames-463327493-project-member] Enqueued Resource ID: 43255fe7-9062-49a0-a8ff-2aab46177272 with Priority: HIGHEST for action security_group_rules [ 664.853406] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 43255fe7-9062-49a0-a8ff-2aab46177272 with Priority: HIGHEST for action security_group_rules [ 664.853406] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-43255fe7-9062-49a0-a8ff-2aab46177272 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.853574] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-43255fe7-9062-49a0-a8ff-2aab46177272" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.065120] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.065271] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.065346] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.065562] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.065652] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.065758] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 43255fe7-9062-49a0-a8ff-2aab46177272 already deleted. [ 665.066488] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-43255fe7-9062-49a0-a8ff-2aab46177272" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.066488] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-43255fe7-9062-49a0-a8ff-2aab46177272" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.066488] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-43255fe7-9062-49a0-a8ff-2aab46177272" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.066488] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('43255fe7-9062-49a0-a8ff-2aab46177272',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.174219] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 68c1ee4d-5f5e-423f-b6c3-cf07470f2258 [ 665.174219] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.174219] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.174219] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.174219] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.174219] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.174219] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:68c1ee4d-5f5e-423f-b6c3-cf07470f2258 already deleted. [ 665.174515] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-68c1ee4d-5f5e-423f-b6c3-cf07470f2258" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.427486] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4e9db3bb-e903-42d7-b7e6-e365ea0c7f5f in Status: SUCCESS [ 665.427702] env[69188]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4e9db3bb-e903-42d7-b7e6-e365ea0c7f5f deletion is rescheduled due to dependency. [ 665.427824] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4e9db3bb-e903-42d7-b7e6-e365ea0c7f5f" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.590896] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.590896] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.590896] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.590896] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.590896] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.590896] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 43255fe7-9062-49a0-a8ff-2aab46177272 already deleted. [ 665.590896] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-43255fe7-9062-49a0-a8ff-2aab46177272" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.104561] env[69188]: INFO networking_nsxv3.common.synchronization [None req-1ac96d2f-5ee9-4859-bf58-4dd6ee235e1b None None] Enqueued Resource ID: c33f3e20-71a1-460e-a22f-63917e0ac8b3 with Priority: HIGHEST for action port [ 667.105228] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c33f3e20-71a1-460e-a22f-63917e0ac8b3 with Priority: HIGHEST for action port [ 667.105554] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-c33f3e20-71a1-460e-a22f-63917e0ac8b3 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.105680] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c33f3e20-71a1-460e-a22f-63917e0ac8b3" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.105737] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c33f3e20-71a1-460e-a22f-63917e0ac8b3" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.106294] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c33f3e20-71a1-460e-a22f-63917e0ac8b3" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.106388] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c33f3e20-71a1-460e-a22f-63917e0ac8b3',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.610872] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c33f3e20-71a1-460e-a22f-63917e0ac8b3 [ 667.610872] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.610872] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.611112] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.611288] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.611288] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.611380] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c33f3e20-71a1-460e-a22f-63917e0ac8b3 already deleted. [ 667.611462] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c33f3e20-71a1-460e-a22f-63917e0ac8b3" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.303745] env[69188]: INFO networking_nsxv3.common.synchronization [req-35e1ff31-bbf0-4689-82ba-0f8e63909c29 req-a2942d9b-1df5-431c-9c61-aa5ec3f7f55d tempest-SecurityGroupRulesTestJSON-1237235967 tempest-SecurityGroupRulesTestJSON-1237235967-project-member] Enqueued Resource ID: 12c98fff-427a-4f91-810e-859f7e9d698d with Priority: HIGHEST for action security_group_rules [ 668.304413] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 12c98fff-427a-4f91-810e-859f7e9d698d with Priority: HIGHEST for action security_group_rules [ 668.304831] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-12c98fff-427a-4f91-810e-859f7e9d698d taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.304983] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-12c98fff-427a-4f91-810e-859f7e9d698d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.305087] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-12c98fff-427a-4f91-810e-859f7e9d698d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.305366] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-12c98fff-427a-4f91-810e-859f7e9d698d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.305476] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('12c98fff-427a-4f91-810e-859f7e9d698d',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.826049] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.826285] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.826285] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.826537] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.826631] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.826766] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 12c98fff-427a-4f91-810e-859f7e9d698d already deleted. [ 668.826865] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-12c98fff-427a-4f91-810e-859f7e9d698d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.475341] env[69188]: INFO networking_nsxv3.common.synchronization [None req-fb9733f0-0f41-4cf6-80f5-3f2c7d15b4be None None] Enqueued Resource ID: 11f7a715-2ef6-44e4-b98e-19506dd1d46f with Priority: HIGHEST for action port [ 669.475613] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 11f7a715-2ef6-44e4-b98e-19506dd1d46f with Priority: HIGHEST for action port [ 669.477179] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-11f7a715-2ef6-44e4-b98e-19506dd1d46f taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.477179] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-11f7a715-2ef6-44e4-b98e-19506dd1d46f" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.477179] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-11f7a715-2ef6-44e4-b98e-19506dd1d46f" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.477179] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-11f7a715-2ef6-44e4-b98e-19506dd1d46f" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.477179] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('11f7a715-2ef6-44e4-b98e-19506dd1d46f',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.980800] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 11f7a715-2ef6-44e4-b98e-19506dd1d46f [ 669.981097] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.981289] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.981371] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.981619] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.981758] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.981869] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:11f7a715-2ef6-44e4-b98e-19506dd1d46f already deleted. [ 669.981970] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-11f7a715-2ef6-44e4-b98e-19506dd1d46f" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.330216] env[69188]: INFO networking_nsxv3.common.synchronization [req-38d2f39e-252c-4184-b972-b8c1b3707307 req-47841876-dee5-411a-95b3-b6b7eb7b0e13 tempest-SecurityGroupRulesTestJSON-1237235967 tempest-SecurityGroupRulesTestJSON-1237235967-project-member] Enqueued Resource ID: 0f92a853-efcb-481c-b0b2-a1e633735d67 with Priority: HIGHEST for action security_group_rules [ 670.330216] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0f92a853-efcb-481c-b0b2-a1e633735d67 with Priority: HIGHEST for action security_group_rules [ 670.330216] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0f92a853-efcb-481c-b0b2-a1e633735d67 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.330216] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0f92a853-efcb-481c-b0b2-a1e633735d67" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.330216] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0f92a853-efcb-481c-b0b2-a1e633735d67" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.330216] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0f92a853-efcb-481c-b0b2-a1e633735d67" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.330216] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0f92a853-efcb-481c-b0b2-a1e633735d67',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.648970] env[69188]: INFO networking_nsxv3.common.synchronization [None req-e83d2f0f-69af-420a-8619-f77791d50a5c None None] Enqueued Resource ID: 986ffdda-4f02-48d0-b7dc-a7d9d312d928 with Priority: HIGHEST for action port [ 670.649784] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 986ffdda-4f02-48d0-b7dc-a7d9d312d928 with Priority: HIGHEST for action port [ 670.651580] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-986ffdda-4f02-48d0-b7dc-a7d9d312d928 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.651674] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-986ffdda-4f02-48d0-b7dc-a7d9d312d928" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.651747] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-986ffdda-4f02-48d0-b7dc-a7d9d312d928" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.652028] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-986ffdda-4f02-48d0-b7dc-a7d9d312d928" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.652124] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('986ffdda-4f02-48d0-b7dc-a7d9d312d928',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.851592] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.851592] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.851592] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.851592] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.851592] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.851592] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0f92a853-efcb-481c-b0b2-a1e633735d67 already deleted. [ 670.851592] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0f92a853-efcb-481c-b0b2-a1e633735d67" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.154933] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 986ffdda-4f02-48d0-b7dc-a7d9d312d928 [ 671.155122] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.155228] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.155277] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.155492] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.155580] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.156036] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:986ffdda-4f02-48d0-b7dc-a7d9d312d928 already deleted. [ 671.156036] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-986ffdda-4f02-48d0-b7dc-a7d9d312d928" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.919802] env[69188]: INFO networking_nsxv3.common.synchronization [None req-39ce4930-3bf1-4266-8bf3-b612b2331118 None None] Enqueued Resource ID: fca87659-f811-4585-8950-b12e077de8df with Priority: HIGHEST for action port [ 671.920880] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fca87659-f811-4585-8950-b12e077de8df with Priority: HIGHEST for action port [ 671.920880] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-fca87659-f811-4585-8950-b12e077de8df taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.920880] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fca87659-f811-4585-8950-b12e077de8df" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.921324] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fca87659-f811-4585-8950-b12e077de8df" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.924019] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fca87659-f811-4585-8950-b12e077de8df" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.924019] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fca87659-f811-4585-8950-b12e077de8df',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.426540] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port fca87659-f811-4585-8950-b12e077de8df [ 672.426764] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.426896] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.426966] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.427226] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.427434] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.427434] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:fca87659-f811-4585-8950-b12e077de8df already deleted. [ 672.427544] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fca87659-f811-4585-8950-b12e077de8df" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.028146] env[69188]: INFO networking_nsxv3.common.synchronization [None req-0a8ef45f-0c1c-43a3-bfa3-6ab3c0d31cd0 None None] Enqueued Resource ID: 37deb620-8c43-4d0a-aa0b-3764095d23fe with Priority: HIGHEST for action port [ 674.028146] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 37deb620-8c43-4d0a-aa0b-3764095d23fe with Priority: HIGHEST for action port [ 674.028596] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-37deb620-8c43-4d0a-aa0b-3764095d23fe taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.028856] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-37deb620-8c43-4d0a-aa0b-3764095d23fe" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.028856] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-37deb620-8c43-4d0a-aa0b-3764095d23fe" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.029216] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-37deb620-8c43-4d0a-aa0b-3764095d23fe" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.029319] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('37deb620-8c43-4d0a-aa0b-3764095d23fe',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.135638] env[69188]: INFO networking_nsxv3.common.synchronization [req-e7fa3482-6107-40a0-847f-648093e0751e req-38cc106b-e139-478d-bf9f-85b7271c177c tempest-SecurityGroupRulesTestJSON-1237235967 tempest-SecurityGroupRulesTestJSON-1237235967-project-member] Enqueued Resource ID: 50fc4f7b-cc0b-4cab-a274-ac85becea226 with Priority: HIGHEST for action security_group_rules [ 674.136866] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 50fc4f7b-cc0b-4cab-a274-ac85becea226 with Priority: HIGHEST for action security_group_rules [ 674.136866] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-50fc4f7b-cc0b-4cab-a274-ac85becea226 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.136866] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-50fc4f7b-cc0b-4cab-a274-ac85becea226" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.136866] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-50fc4f7b-cc0b-4cab-a274-ac85becea226" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.137269] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-50fc4f7b-cc0b-4cab-a274-ac85becea226" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.137424] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('50fc4f7b-cc0b-4cab-a274-ac85becea226',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.531924] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 37deb620-8c43-4d0a-aa0b-3764095d23fe [ 674.532429] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.532674] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.532757] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.532972] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.533076] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.533171] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:37deb620-8c43-4d0a-aa0b-3764095d23fe already deleted. [ 674.533250] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-37deb620-8c43-4d0a-aa0b-3764095d23fe" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.659964] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.661293] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.661394] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.661645] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.661803] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.661867] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 50fc4f7b-cc0b-4cab-a274-ac85becea226 already deleted. [ 674.662007] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-50fc4f7b-cc0b-4cab-a274-ac85becea226" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.658339] env[69188]: INFO networking_nsxv3.common.synchronization [None req-56e7cf51-72ca-4284-bbf2-b0ce9419b805 tempest-ServerActionsTestJSON-1027345226 tempest-ServerActionsTestJSON-1027345226-project-member] Enqueued Resource ID: 9482bec7-7d68-4fe1-8d77-d380c3f6dc7a with Priority: HIGHEST for action security_group_rules [ 675.659546] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9482bec7-7d68-4fe1-8d77-d380c3f6dc7a with Priority: HIGHEST for action security_group_rules [ 675.659918] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9482bec7-7d68-4fe1-8d77-d380c3f6dc7a taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.660577] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9482bec7-7d68-4fe1-8d77-d380c3f6dc7a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.660661] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9482bec7-7d68-4fe1-8d77-d380c3f6dc7a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.660963] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9482bec7-7d68-4fe1-8d77-d380c3f6dc7a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.661153] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9482bec7-7d68-4fe1-8d77-d380c3f6dc7a',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.867751] env[69188]: INFO networking_nsxv3.common.synchronization [None req-2b5b6f9b-365d-4d12-9738-0d3753f9e456 tempest-ServerActionsTestJSON-1027345226 tempest-ServerActionsTestJSON-1027345226-project-member] Enqueued Resource ID: 9482bec7-7d68-4fe1-8d77-d380c3f6dc7a with Priority: HIGHEST for action security_group_rules [ 675.868589] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9482bec7-7d68-4fe1-8d77-d380c3f6dc7a with Priority: HIGHEST for action security_group_rules [ 675.868993] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9482bec7-7d68-4fe1-8d77-d380c3f6dc7a taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.869098] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9482bec7-7d68-4fe1-8d77-d380c3f6dc7a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.989160] env[69188]: INFO networking_nsxv3.common.synchronization [req-77c39168-b4b0-471e-90cd-9c1e6d52d806 req-70b49909-db6b-4969-a9f8-c792a72919ac tempest-SecurityGroupRulesTestJSON-1237235967 tempest-SecurityGroupRulesTestJSON-1237235967-project-member] Enqueued Resource ID: 0dff39ae-1696-4a8d-ba5a-f5ad6712b2c0 with Priority: HIGHEST for action security_group_rules [ 675.990199] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0dff39ae-1696-4a8d-ba5a-f5ad6712b2c0 with Priority: HIGHEST for action security_group_rules [ 675.990756] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0dff39ae-1696-4a8d-ba5a-f5ad6712b2c0 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.990888] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0dff39ae-1696-4a8d-ba5a-f5ad6712b2c0" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.990951] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0dff39ae-1696-4a8d-ba5a-f5ad6712b2c0" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.991289] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0dff39ae-1696-4a8d-ba5a-f5ad6712b2c0" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.991289] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0dff39ae-1696-4a8d-ba5a-f5ad6712b2c0',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 676.182954] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.184391] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.185863] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.185863] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.185863] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.186251] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9482bec7-7d68-4fe1-8d77-d380c3f6dc7a already deleted. [ 676.186251] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9482bec7-7d68-4fe1-8d77-d380c3f6dc7a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.186461] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9482bec7-7d68-4fe1-8d77-d380c3f6dc7a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.186655] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9482bec7-7d68-4fe1-8d77-d380c3f6dc7a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.186740] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9482bec7-7d68-4fe1-8d77-d380c3f6dc7a',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 676.221059] env[69188]: INFO networking_nsxv3.common.synchronization [req-d7aa0f97-39e9-40f7-9d14-52558c292085 req-eb6b97b7-7d94-4ca8-b936-44a33a2e6afc tempest-ServersAdminNegativeTestJSON-68746947 tempest-ServersAdminNegativeTestJSON-68746947-project-member] Enqueued Resource ID: b8569476-f644-46f4-87dc-5a1d19af31a2 with Priority: HIGHEST for action security_group_members [ 676.223125] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8569476-f644-46f4-87dc-5a1d19af31a2 with Priority: HIGHEST for action security_group_members [ 676.223125] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8569476-f644-46f4-87dc-5a1d19af31a2 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.223125] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8569476-f644-46f4-87dc-5a1d19af31a2" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.223125] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8569476-f644-46f4-87dc-5a1d19af31a2" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.223125] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8569476-f644-46f4-87dc-5a1d19af31a2" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.223125] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.223125] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.223125] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.223125] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.223125] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.223125] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b8569476-f644-46f4-87dc-5a1d19af31a2',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 676.506574] env[69188]: INFO networking_nsxv3.common.synchronization [req-35b8b92e-3cb4-4dab-8b94-d21a378ad18d req-2c82dc37-004d-42be-b1bf-e41958df5e69 tempest-ImagesOneServerNegativeTestJSON-1186419322 tempest-ImagesOneServerNegativeTestJSON-1186419322-project-member] Enqueued Resource ID: 9d153fe4-605f-47fe-a33b-9d019b977fa7 with Priority: HIGHEST for action security_group_members [ 676.506574] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9d153fe4-605f-47fe-a33b-9d019b977fa7 with Priority: HIGHEST for action security_group_members [ 676.506574] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-9d153fe4-605f-47fe-a33b-9d019b977fa7 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.506807] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9d153fe4-605f-47fe-a33b-9d019b977fa7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.506807] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9d153fe4-605f-47fe-a33b-9d019b977fa7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.507044] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9d153fe4-605f-47fe-a33b-9d019b977fa7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.508203] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.508346] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.508413] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.508608] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.509030] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.509030] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9d153fe4-605f-47fe-a33b-9d019b977fa7',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 676.513884] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.514067] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.514116] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.514348] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.517345] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.517345] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0dff39ae-1696-4a8d-ba5a-f5ad6712b2c0 already deleted. [ 676.517345] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0dff39ae-1696-4a8d-ba5a-f5ad6712b2c0" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.710940] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.711260] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.711385] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.712162] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.712162] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.712162] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9482bec7-7d68-4fe1-8d77-d380c3f6dc7a already deleted. [ 676.712162] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9482bec7-7d68-4fe1-8d77-d380c3f6dc7a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.725308] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b8569476-f644-46f4-87dc-5a1d19af31a2',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 676.820454] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock network-267 taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.822221] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "network-267" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.822221] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "network-267" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.822221] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "network-267" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.822221] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.825689] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.825689] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.825689] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.825689] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.825689] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 676.825689] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] NeedRegenerationException {{(pid=69188) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 676.825689] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] no value, waiting for create lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 676.825689] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] value creation lock acquired {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 676.825689] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 676.825689] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Calling creation function for not-yet-present value {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 676.825689] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 676.843505] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 676.843505] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69188) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 676.843505] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Released creation lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 676.843505] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "network-267" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.843505] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock port-307047b4-c355-48de-a2b6-07026792ea25 taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.843505] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "port-307047b4-c355-48de-a2b6-07026792ea25" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.843505] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "port-307047b4-c355-48de-a2b6-07026792ea25" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.845235] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "port-307047b4-c355-48de-a2b6-07026792ea25" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.845235] env[69188]: DEBUG networking_nsxv3.api.rpc [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('307047b4-c355-48de-a2b6-07026792ea25',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 676.905505] env[69188]: INFO networking_nsxv3.common.synchronization [None req-e51722d2-4a6f-426e-8ae4-f83143b80c5e None None] Enqueued Resource ID: 3ed9e9e4-310d-474f-81a3-d39cadfba6a4 with Priority: HIGHEST for action port [ 676.905674] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3ed9e9e4-310d-474f-81a3-d39cadfba6a4 with Priority: HIGHEST for action port [ 676.909560] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-3ed9e9e4-310d-474f-81a3-d39cadfba6a4 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.909560] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3ed9e9e4-310d-474f-81a3-d39cadfba6a4" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.909560] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3ed9e9e4-310d-474f-81a3-d39cadfba6a4" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.909560] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3ed9e9e4-310d-474f-81a3-d39cadfba6a4" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.909560] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3ed9e9e4-310d-474f-81a3-d39cadfba6a4',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.014771] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.014771] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.014771] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.014771] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.014771] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.014771] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.014771] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.014771] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.014771] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.014771] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.014771] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9d153fe4-605f-47fe-a33b-9d019b977fa7 is going to be updated. [ 677.039933] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.040115] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.040185] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.040423] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.040632] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.053615] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9d153fe4-605f-47fe-a33b-9d019b977fa7 in Status: IN_PROGRESS for 2s [ 677.231581] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b8569476-f644-46f4-87dc-5a1d19af31a2',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.348099] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.348099] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.348099] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.348431] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.348431] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.348503] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Segment Port 307047b4-c355-48de-a2b6-07026792ea25 not found, creating... [ 677.348726] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.348871] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.348996] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.349226] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.349519] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.349677] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.349799] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.349919] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.350325] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.350517] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.350717] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Resource: SegmentPort with ID: 307047b4-c355-48de-a2b6-07026792ea25 is going to be created. [ 677.369689] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.370462] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.370462] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.370462] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.370616] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.370783] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "port-307047b4-c355-48de-a2b6-07026792ea25" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.410297] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3ed9e9e4-310d-474f-81a3-d39cadfba6a4 [ 677.410297] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.410297] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.410297] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.410297] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.410297] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.410297] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3ed9e9e4-310d-474f-81a3-d39cadfba6a4 already deleted. [ 677.410297] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3ed9e9e4-310d-474f-81a3-d39cadfba6a4" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.735654] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.735654] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.735654] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.735654] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.735654] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.735654] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b8569476-f644-46f4-87dc-5a1d19af31a2 is going to be updated. [ 677.768061] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.768061] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.768061] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.768061] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.768061] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.776949] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b8569476-f644-46f4-87dc-5a1d19af31a2 in Status: IN_PROGRESS for 2s [ 678.233134] env[69188]: INFO networking_nsxv3.common.synchronization [None req-7524ca37-8dcf-4b37-945c-55a90a8a9cd8 None None] Enqueued Resource ID: 53e8ddc1-7615-4723-80dd-8b0ed50ab031 with Priority: HIGHEST for action port [ 678.233766] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 53e8ddc1-7615-4723-80dd-8b0ed50ab031 with Priority: HIGHEST for action port [ 678.234393] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-53e8ddc1-7615-4723-80dd-8b0ed50ab031 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.234583] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-53e8ddc1-7615-4723-80dd-8b0ed50ab031" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.234680] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-53e8ddc1-7615-4723-80dd-8b0ed50ab031" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.235249] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-53e8ddc1-7615-4723-80dd-8b0ed50ab031" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.235361] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('53e8ddc1-7615-4723-80dd-8b0ed50ab031',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.297586] env[69188]: INFO networking_nsxv3.common.synchronization [req-908310a2-c484-491c-bf25-a2351dc805ec req-0e50a830-d761-4c0e-b74b-f05a6eeb1242 tempest-SecurityGroupRulesTestJSON-1237235967 tempest-SecurityGroupRulesTestJSON-1237235967-project-member] Enqueued Resource ID: 298ec2e1-fb74-4da4-af49-fb47e8f3628d with Priority: HIGHEST for action security_group_rules [ 678.298620] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 298ec2e1-fb74-4da4-af49-fb47e8f3628d with Priority: HIGHEST for action security_group_rules [ 678.298980] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-298ec2e1-fb74-4da4-af49-fb47e8f3628d taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.299107] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-298ec2e1-fb74-4da4-af49-fb47e8f3628d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.299169] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-298ec2e1-fb74-4da4-af49-fb47e8f3628d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.299514] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-298ec2e1-fb74-4da4-af49-fb47e8f3628d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.299624] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('298ec2e1-fb74-4da4-af49-fb47e8f3628d',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.706729] env[69188]: INFO networking_nsxv3.common.synchronization [req-d7aa0f97-39e9-40f7-9d14-52558c292085 req-0787016a-0d27-4cca-bea6-6d6c82a427b1 service nova] Enqueued Resource ID: b8569476-f644-46f4-87dc-5a1d19af31a2 with Priority: HIGHEST for action security_group_rules [ 678.706896] env[69188]: INFO networking_nsxv3.common.synchronization [req-d7aa0f97-39e9-40f7-9d14-52558c292085 req-0787016a-0d27-4cca-bea6-6d6c82a427b1 service nova] Enqueued Resource ID: b8569476-f644-46f4-87dc-5a1d19af31a2 with Priority: HIGHEST for action security_group_members [ 678.707634] env[69188]: INFO networking_nsxv3.common.synchronization [req-d7aa0f97-39e9-40f7-9d14-52558c292085 req-0787016a-0d27-4cca-bea6-6d6c82a427b1 service nova] Enqueued Resource ID: 307047b4-c355-48de-a2b6-07026792ea25 with Priority: HIGHEST for action port [ 678.709513] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8569476-f644-46f4-87dc-5a1d19af31a2 with Priority: HIGHEST for action security_group_rules [ 678.709513] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8569476-f644-46f4-87dc-5a1d19af31a2 with Priority: HIGHEST for action security_group_members [ 678.709674] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 307047b4-c355-48de-a2b6-07026792ea25 with Priority: HIGHEST for action port [ 678.710250] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b8569476-f644-46f4-87dc-5a1d19af31a2 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.710379] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b8569476-f644-46f4-87dc-5a1d19af31a2" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.710447] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b8569476-f644-46f4-87dc-5a1d19af31a2" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.710658] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b8569476-f644-46f4-87dc-5a1d19af31a2" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.710739] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b8569476-f644-46f4-87dc-5a1d19af31a2',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.711701] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8569476-f644-46f4-87dc-5a1d19af31a2 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.718169] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8569476-f644-46f4-87dc-5a1d19af31a2" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.718169] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-307047b4-c355-48de-a2b6-07026792ea25 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.718169] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-307047b4-c355-48de-a2b6-07026792ea25" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.718169] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-307047b4-c355-48de-a2b6-07026792ea25" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.718481] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-307047b4-c355-48de-a2b6-07026792ea25" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.718523] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('307047b4-c355-48de-a2b6-07026792ea25',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.737771] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 53e8ddc1-7615-4723-80dd-8b0ed50ab031 [ 678.738066] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.738955] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.739067] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.739283] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.739374] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.739489] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:53e8ddc1-7615-4723-80dd-8b0ed50ab031 already deleted. [ 678.739568] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-53e8ddc1-7615-4723-80dd-8b0ed50ab031" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.820592] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.820592] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.820592] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.820592] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.820592] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.820592] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 298ec2e1-fb74-4da4-af49-fb47e8f3628d already deleted. [ 678.820592] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-298ec2e1-fb74-4da4-af49-fb47e8f3628d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.934806] env[69188]: INFO networking_nsxv3.common.synchronization [req-c86b1392-be2d-4da0-9b8c-31896f9726f3 req-fda92edd-77a8-40e7-9ee4-34234a7e0732 tempest-SecurityGroupRulesTestJSON-1237235967 tempest-SecurityGroupRulesTestJSON-1237235967-project-member] Enqueued Resource ID: 298ec2e1-fb74-4da4-af49-fb47e8f3628d with Priority: HIGHEST for action security_group_rules [ 678.936301] env[69188]: INFO networking_nsxv3.common.synchronization [req-41a13619-b298-4e2b-8c19-ecefab55288a req-153af9ab-5d00-42c1-8ce9-607e414bb431 tempest-ListServerFiltersTestJSON-1426102960 tempest-ListServerFiltersTestJSON-1426102960-project-member] Enqueued Resource ID: e2f14ed1-21b8-4d1e-b6bc-559e167b9967 with Priority: HIGHEST for action security_group_members [ 678.937142] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 298ec2e1-fb74-4da4-af49-fb47e8f3628d with Priority: HIGHEST for action security_group_rules [ 678.937379] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2f14ed1-21b8-4d1e-b6bc-559e167b9967 with Priority: HIGHEST for action security_group_members [ 678.937818] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-298ec2e1-fb74-4da4-af49-fb47e8f3628d taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.938570] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-298ec2e1-fb74-4da4-af49-fb47e8f3628d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.938570] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-298ec2e1-fb74-4da4-af49-fb47e8f3628d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.938570] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-298ec2e1-fb74-4da4-af49-fb47e8f3628d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.938570] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('298ec2e1-fb74-4da4-af49-fb47e8f3628d',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.940155] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2f14ed1-21b8-4d1e-b6bc-559e167b9967 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.940431] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2f14ed1-21b8-4d1e-b6bc-559e167b9967" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.940517] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2f14ed1-21b8-4d1e-b6bc-559e167b9967" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.940830] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2f14ed1-21b8-4d1e-b6bc-559e167b9967" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.941129] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.941313] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.941446] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.941735] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.941970] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.942158] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e2f14ed1-21b8-4d1e-b6bc-559e167b9967',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.068413] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9d153fe4-605f-47fe-a33b-9d019b977fa7 in Status: SUCCESS [ 679.068518] env[69188]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9d153fe4-605f-47fe-a33b-9d019b977fa7 deletion is rescheduled due to dependency. [ 679.068631] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9d153fe4-605f-47fe-a33b-9d019b977fa7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.220441] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8569476-f644-46f4-87dc-5a1d19af31a2 taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.221547] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8569476-f644-46f4-87dc-5a1d19af31a2" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.221547] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 307047b4-c355-48de-a2b6-07026792ea25 with status ACTIVE [ 679.221547] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.221547] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.221775] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.221775] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.225273] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.225510] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.225643] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.225707] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.225923] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.226032] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.226390] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.226390] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.226502] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.226567] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.226656] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.226741] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 307047b4-c355-48de-a2b6-07026792ea25 is going to be updated. [ 679.245183] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.245475] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.245475] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.245733] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.245733] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.248034] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-307047b4-c355-48de-a2b6-07026792ea25" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.371476] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock network-599 taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.371707] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "network-599" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.371834] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "network-599" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.372825] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "network-599" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.372825] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.372825] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.372825] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.375106] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.375219] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.375492] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 679.375623] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] NeedRegenerationException {{(pid=69188) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 679.375735] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] no value, waiting for create lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 679.376103] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] value creation lock acquired {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 679.376270] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 679.377181] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Calling creation function for not-yet-present value {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 679.377418] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 679.402115] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 679.402115] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=69188) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 679.402309] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Released creation lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 679.402388] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "network-599" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.402743] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock port-f6303034-67bb-4e19-851c-f6a1f1987dc6 taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.402947] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "port-f6303034-67bb-4e19-851c-f6a1f1987dc6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.403112] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "port-f6303034-67bb-4e19-851c-f6a1f1987dc6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.403679] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "port-f6303034-67bb-4e19-851c-f6a1f1987dc6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.403679] env[69188]: DEBUG networking_nsxv3.api.rpc [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f6303034-67bb-4e19-851c-f6a1f1987dc6',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.445924] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.445924] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.446121] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.446225] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.446317] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.446536] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.446644] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.446702] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.446888] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.446997] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.447115] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e2f14ed1-21b8-4d1e-b6bc-559e167b9967 already deleted. [ 679.447210] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2f14ed1-21b8-4d1e-b6bc-559e167b9967" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.464209] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.464209] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.464209] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.464209] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.464209] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.464209] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 298ec2e1-fb74-4da4-af49-fb47e8f3628d already deleted. [ 679.464209] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-298ec2e1-fb74-4da4-af49-fb47e8f3628d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.789609] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b8569476-f644-46f4-87dc-5a1d19af31a2 in Status: SUCCESS [ 679.790436] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8569476-f644-46f4-87dc-5a1d19af31a2" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.790436] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8569476-f644-46f4-87dc-5a1d19af31a2" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.790436] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8569476-f644-46f4-87dc-5a1d19af31a2" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.790570] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.790723] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.790723] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.790893] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.790893] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.790997] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b8569476-f644-46f4-87dc-5a1d19af31a2',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.906671] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.906908] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.907104] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.907489] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.907672] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.907835] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Segment Port f6303034-67bb-4e19-851c-f6a1f1987dc6 not found, creating... [ 679.908158] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.908287] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.909373] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.909373] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.909373] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.911304] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.911506] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.912017] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.912295] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.912439] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.912586] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Resource: SegmentPort with ID: f6303034-67bb-4e19-851c-f6a1f1987dc6 is going to be created. [ 679.943453] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.943750] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.943834] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.944417] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.944734] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.945080] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "port-f6303034-67bb-4e19-851c-f6a1f1987dc6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.117239] env[69188]: INFO networking_nsxv3.common.synchronization [req-45764e9c-84f1-4309-9ab6-ba0e91f5b9e4 req-17114c49-5581-44cf-bc62-e051b1c0f875 tempest-SecurityGroupRulesTestJSON-1237235967 tempest-SecurityGroupRulesTestJSON-1237235967-project-member] Enqueued Resource ID: 298ec2e1-fb74-4da4-af49-fb47e8f3628d with Priority: HIGHEST for action security_group_rules [ 680.120469] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 298ec2e1-fb74-4da4-af49-fb47e8f3628d with Priority: HIGHEST for action security_group_rules [ 680.120958] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-298ec2e1-fb74-4da4-af49-fb47e8f3628d taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.121069] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-298ec2e1-fb74-4da4-af49-fb47e8f3628d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.121069] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-298ec2e1-fb74-4da4-af49-fb47e8f3628d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.121266] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-298ec2e1-fb74-4da4-af49-fb47e8f3628d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.121417] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('298ec2e1-fb74-4da4-af49-fb47e8f3628d',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.294854] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b8569476-f644-46f4-87dc-5a1d19af31a2',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.644912] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.644912] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.644912] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.644912] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.644912] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.644912] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 298ec2e1-fb74-4da4-af49-fb47e8f3628d already deleted. [ 680.644912] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-298ec2e1-fb74-4da4-af49-fb47e8f3628d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.799607] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b8569476-f644-46f4-87dc-5a1d19af31a2',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.951184] env[69188]: INFO networking_nsxv3.common.synchronization [req-41a13619-b298-4e2b-8c19-ecefab55288a req-438a7c29-aa78-4620-bcd1-e21458a3e34b service nova] Enqueued Resource ID: e2f14ed1-21b8-4d1e-b6bc-559e167b9967 with Priority: HIGHEST for action security_group_rules [ 680.951463] env[69188]: INFO networking_nsxv3.common.synchronization [req-41a13619-b298-4e2b-8c19-ecefab55288a req-438a7c29-aa78-4620-bcd1-e21458a3e34b service nova] Enqueued Resource ID: e2f14ed1-21b8-4d1e-b6bc-559e167b9967 with Priority: HIGHEST for action security_group_members [ 680.951697] env[69188]: INFO networking_nsxv3.common.synchronization [req-41a13619-b298-4e2b-8c19-ecefab55288a req-438a7c29-aa78-4620-bcd1-e21458a3e34b service nova] Enqueued Resource ID: f6303034-67bb-4e19-851c-f6a1f1987dc6 with Priority: HIGHEST for action port [ 680.952230] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2f14ed1-21b8-4d1e-b6bc-559e167b9967 with Priority: HIGHEST for action security_group_rules [ 680.952403] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2f14ed1-21b8-4d1e-b6bc-559e167b9967 with Priority: HIGHEST for action security_group_members [ 680.952535] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f6303034-67bb-4e19-851c-f6a1f1987dc6 with Priority: HIGHEST for action port [ 680.953178] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e2f14ed1-21b8-4d1e-b6bc-559e167b9967 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.953377] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e2f14ed1-21b8-4d1e-b6bc-559e167b9967" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.953472] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e2f14ed1-21b8-4d1e-b6bc-559e167b9967" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.953803] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e2f14ed1-21b8-4d1e-b6bc-559e167b9967" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.953967] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e2f14ed1-21b8-4d1e-b6bc-559e167b9967',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.955168] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2f14ed1-21b8-4d1e-b6bc-559e167b9967 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.955388] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2f14ed1-21b8-4d1e-b6bc-559e167b9967" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.955654] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2f14ed1-21b8-4d1e-b6bc-559e167b9967" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.955848] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2f14ed1-21b8-4d1e-b6bc-559e167b9967" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.956100] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.956267] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.956414] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.956663] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.956799] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.956977] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e2f14ed1-21b8-4d1e-b6bc-559e167b9967',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.957893] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-f6303034-67bb-4e19-851c-f6a1f1987dc6 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.961152] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f6303034-67bb-4e19-851c-f6a1f1987dc6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.961224] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f6303034-67bb-4e19-851c-f6a1f1987dc6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.961413] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f6303034-67bb-4e19-851c-f6a1f1987dc6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.962075] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f6303034-67bb-4e19-851c-f6a1f1987dc6',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.119195] env[69188]: INFO networking_nsxv3.common.synchronization [None req-0c4ae007-6a5c-46c0-90af-2cdd585ea687 None None] Enqueued Resource ID: 76d3fe43-96b2-406f-8909-33061b238cd9 with Priority: HIGHEST for action port [ 681.119857] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 76d3fe43-96b2-406f-8909-33061b238cd9 with Priority: HIGHEST for action port [ 681.120197] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-76d3fe43-96b2-406f-8909-33061b238cd9 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.120342] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-76d3fe43-96b2-406f-8909-33061b238cd9" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.120426] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-76d3fe43-96b2-406f-8909-33061b238cd9" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.121143] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-76d3fe43-96b2-406f-8909-33061b238cd9" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.121143] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('76d3fe43-96b2-406f-8909-33061b238cd9',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.307787] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.308309] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.308309] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.308309] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.308309] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.310083] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b8569476-f644-46f4-87dc-5a1d19af31a2 is going to be updated. [ 681.339297] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.339555] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.339555] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.340641] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.340641] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.348985] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b8569476-f644-46f4-87dc-5a1d19af31a2 in Status: IN_PROGRESS for 2s [ 681.463976] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e2f14ed1-21b8-4d1e-b6bc-559e167b9967',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.465421] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2f14ed1-21b8-4d1e-b6bc-559e167b9967 taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.465421] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2f14ed1-21b8-4d1e-b6bc-559e167b9967" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.465421] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f6303034-67bb-4e19-851c-f6a1f1987dc6 with status ACTIVE [ 681.465638] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.465638] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.465726] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.466087] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.466087] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.467533] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.467533] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.467533] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.467724] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.467724] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.467941] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.468036] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.468153] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.468304] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.468584] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.469363] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f6303034-67bb-4e19-851c-f6a1f1987dc6 is going to be updated. [ 681.490896] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.491063] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.491464] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.491464] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.491629] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.491671] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f6303034-67bb-4e19-851c-f6a1f1987dc6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.622958] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 76d3fe43-96b2-406f-8909-33061b238cd9 [ 681.623310] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.623502] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.623600] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.623828] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.623923] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.624031] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:76d3fe43-96b2-406f-8909-33061b238cd9 already deleted. [ 681.624119] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-76d3fe43-96b2-406f-8909-33061b238cd9" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.971553] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e2f14ed1-21b8-4d1e-b6bc-559e167b9967',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.106573] env[69188]: INFO networking_nsxv3.common.synchronization [None req-b5031a9a-1641-48c7-b647-aa86a5ce64e7 None None] Enqueued Resource ID: 1c178c5c-95fa-4048-b8fa-7e4af4b0a23e with Priority: HIGHEST for action port [ 682.106573] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1c178c5c-95fa-4048-b8fa-7e4af4b0a23e with Priority: HIGHEST for action port [ 682.106573] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-1c178c5c-95fa-4048-b8fa-7e4af4b0a23e taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.106573] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1c178c5c-95fa-4048-b8fa-7e4af4b0a23e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.106573] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1c178c5c-95fa-4048-b8fa-7e4af4b0a23e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.107429] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1c178c5c-95fa-4048-b8fa-7e4af4b0a23e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.107540] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1c178c5c-95fa-4048-b8fa-7e4af4b0a23e',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.473907] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.474148] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.474305] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.474550] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.474694] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.474847] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e2f14ed1-21b8-4d1e-b6bc-559e167b9967 is going to be created. [ 682.498117] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.498361] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.498719] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.498883] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.499096] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.510332] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e2f14ed1-21b8-4d1e-b6bc-559e167b9967 in Status: UNINITIALIZED for 2s [ 682.611171] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1c178c5c-95fa-4048-b8fa-7e4af4b0a23e [ 682.611171] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.611332] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.611332] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.611522] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.611582] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.613325] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1c178c5c-95fa-4048-b8fa-7e4af4b0a23e already deleted. [ 682.613325] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1c178c5c-95fa-4048-b8fa-7e4af4b0a23e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.358600] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b8569476-f644-46f4-87dc-5a1d19af31a2 in Status: SUCCESS [ 683.359929] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8569476-f644-46f4-87dc-5a1d19af31a2" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.360255] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8569476-f644-46f4-87dc-5a1d19af31a2" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.360586] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8569476-f644-46f4-87dc-5a1d19af31a2" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.361303] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.361580] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.362333] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.362640] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.362873] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.363086] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8569476-f644-46f4-87dc-5a1d19af31a2" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.363312] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b8569476-f644-46f4-87dc-5a1d19af31a2',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.865993] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8569476-f644-46f4-87dc-5a1d19af31a2 taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.866236] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8569476-f644-46f4-87dc-5a1d19af31a2" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.866305] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8569476-f644-46f4-87dc-5a1d19af31a2" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.866587] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8569476-f644-46f4-87dc-5a1d19af31a2" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.866837] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.866989] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.867189] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.867275] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.867317] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.867400] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8569476-f644-46f4-87dc-5a1d19af31a2" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.867583] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8569476-f644-46f4-87dc-5a1d19af31a2 taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.867689] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8569476-f644-46f4-87dc-5a1d19af31a2" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.867749] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8569476-f644-46f4-87dc-5a1d19af31a2" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.868461] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8569476-f644-46f4-87dc-5a1d19af31a2" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.868461] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.868461] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.868461] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.868461] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.868461] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.868780] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8569476-f644-46f4-87dc-5a1d19af31a2" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.868816] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b8569476-f644-46f4-87dc-5a1d19af31a2',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.948432] env[69188]: INFO networking_nsxv3.common.synchronization [req-ac14c949-1738-454f-96c0-d88b53f93b3a req-f8f7ddff-684a-4728-9ddd-25e4eb6de292 tempest-ListServerFiltersTestJSON-1426102960 tempest-ListServerFiltersTestJSON-1426102960-project-member] Enqueued Resource ID: e2f14ed1-21b8-4d1e-b6bc-559e167b9967 with Priority: HIGHEST for action security_group_members [ 683.948432] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2f14ed1-21b8-4d1e-b6bc-559e167b9967 with Priority: HIGHEST for action security_group_members [ 683.948686] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2f14ed1-21b8-4d1e-b6bc-559e167b9967 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.948686] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2f14ed1-21b8-4d1e-b6bc-559e167b9967" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.335114] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock network-599 taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.335114] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "network-599" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.335225] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "network-599" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.335464] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "network-599" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.335716] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.339120] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.339120] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.339120] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.339120] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.339120] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 684.339120] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] NeedRegenerationException {{(pid=69188) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 684.339120] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] no value, waiting for create lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 684.339120] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] value creation lock acquired {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 684.339120] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 684.339120] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Calling creation function for not-yet-present value {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 684.339120] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 684.358234] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 684.358234] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69188) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 684.358234] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Released creation lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 684.358234] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "network-599" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.358234] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock port-0a65329a-ec17-411d-b432-b1e1a63ca46d taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.358234] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "port-0a65329a-ec17-411d-b432-b1e1a63ca46d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.358234] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "port-0a65329a-ec17-411d-b432-b1e1a63ca46d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.358234] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "port-0a65329a-ec17-411d-b432-b1e1a63ca46d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.358234] env[69188]: DEBUG networking_nsxv3.api.rpc [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0a65329a-ec17-411d-b432-b1e1a63ca46d',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.371108] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b8569476-f644-46f4-87dc-5a1d19af31a2: rpc.has_security_group_logging(os_id): False [ 684.391738] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.391953] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.392099] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.392387] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.392844] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.392844] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.392844] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.392844] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.393500] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.393500] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.393500] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.393500] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.393500] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.393788] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.393788] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.393788] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.393948] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.393948] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.398778] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.398778] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.398778] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b8569476-f644-46f4-87dc-5a1d19af31a2 is going to be updated. [ 684.521191] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e2f14ed1-21b8-4d1e-b6bc-559e167b9967 in Status: SUCCESS [ 684.521191] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2f14ed1-21b8-4d1e-b6bc-559e167b9967" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.521191] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2f14ed1-21b8-4d1e-b6bc-559e167b9967" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.521191] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2f14ed1-21b8-4d1e-b6bc-559e167b9967" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.521365] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.521509] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.521566] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.521723] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.521854] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.521932] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2f14ed1-21b8-4d1e-b6bc-559e167b9967" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.522127] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e2f14ed1-21b8-4d1e-b6bc-559e167b9967',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.524328] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2f14ed1-21b8-4d1e-b6bc-559e167b9967" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.524555] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2f14ed1-21b8-4d1e-b6bc-559e167b9967" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.524737] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.524945] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.524945] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.525120] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.525177] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.525293] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e2f14ed1-21b8-4d1e-b6bc-559e167b9967',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.529479] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.530950] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.531127] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.531439] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.531632] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.547843] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b8569476-f644-46f4-87dc-5a1d19af31a2 in Status: IN_PROGRESS for 2s [ 684.772483] env[69188]: INFO networking_nsxv3.common.synchronization [None req-ae804f6b-7dc1-4222-a940-1f0a2f189b3e None None] Enqueued Resource ID: af0ce44f-d6fe-4986-9b25-05908db6c727 with Priority: HIGHEST for action port [ 684.772899] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: af0ce44f-d6fe-4986-9b25-05908db6c727 with Priority: HIGHEST for action port [ 684.773497] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-af0ce44f-d6fe-4986-9b25-05908db6c727 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.773586] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-af0ce44f-d6fe-4986-9b25-05908db6c727" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.773586] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-af0ce44f-d6fe-4986-9b25-05908db6c727" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.773844] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-af0ce44f-d6fe-4986-9b25-05908db6c727" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.773931] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('af0ce44f-d6fe-4986-9b25-05908db6c727',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.864279] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.864279] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.864279] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.864279] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.864279] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.864606] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Segment Port 0a65329a-ec17-411d-b432-b1e1a63ca46d not found, creating... [ 684.864606] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.865108] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.865108] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.865108] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.865294] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.865548] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.865714] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.865788] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.866255] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.866388] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.866616] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Resource: SegmentPort with ID: 0a65329a-ec17-411d-b432-b1e1a63ca46d is going to be created. [ 684.892034] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.892034] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.892034] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.892034] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.892034] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.892034] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "port-0a65329a-ec17-411d-b432-b1e1a63ca46d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.028046] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2f14ed1-21b8-4d1e-b6bc-559e167b9967 taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.028046] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2f14ed1-21b8-4d1e-b6bc-559e167b9967" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.034939] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e2f14ed1-21b8-4d1e-b6bc-559e167b9967',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.275540] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port af0ce44f-d6fe-4986-9b25-05908db6c727 [ 685.275731] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.275872] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.275943] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.276181] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.277028] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.277028] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:af0ce44f-d6fe-4986-9b25-05908db6c727 already deleted. [ 685.277028] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-af0ce44f-d6fe-4986-9b25-05908db6c727" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.538328] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e2f14ed1-21b8-4d1e-b6bc-559e167b9967',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.016347] env[69188]: INFO networking_nsxv3.common.synchronization [req-ac14c949-1738-454f-96c0-d88b53f93b3a req-400b265b-1942-4c9b-b11f-f8ba6bbb201e service nova] Enqueued Resource ID: e2f14ed1-21b8-4d1e-b6bc-559e167b9967 with Priority: HIGHEST for action security_group_rules [ 686.016558] env[69188]: INFO networking_nsxv3.common.synchronization [req-ac14c949-1738-454f-96c0-d88b53f93b3a req-400b265b-1942-4c9b-b11f-f8ba6bbb201e service nova] Enqueued Resource ID: e2f14ed1-21b8-4d1e-b6bc-559e167b9967 with Priority: HIGHEST for action security_group_members [ 686.016709] env[69188]: INFO networking_nsxv3.common.synchronization [req-ac14c949-1738-454f-96c0-d88b53f93b3a req-400b265b-1942-4c9b-b11f-f8ba6bbb201e service nova] Enqueued Resource ID: 0a65329a-ec17-411d-b432-b1e1a63ca46d with Priority: HIGHEST for action port [ 686.016941] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2f14ed1-21b8-4d1e-b6bc-559e167b9967 with Priority: HIGHEST for action security_group_rules [ 686.017084] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2f14ed1-21b8-4d1e-b6bc-559e167b9967 with Priority: HIGHEST for action security_group_members [ 686.017184] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a65329a-ec17-411d-b432-b1e1a63ca46d with Priority: HIGHEST for action port [ 686.017755] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e2f14ed1-21b8-4d1e-b6bc-559e167b9967 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.017833] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e2f14ed1-21b8-4d1e-b6bc-559e167b9967" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.019219] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2f14ed1-21b8-4d1e-b6bc-559e167b9967 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.019347] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2f14ed1-21b8-4d1e-b6bc-559e167b9967" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.022688] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-0a65329a-ec17-411d-b432-b1e1a63ca46d taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.022688] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0a65329a-ec17-411d-b432-b1e1a63ca46d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.022688] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0a65329a-ec17-411d-b432-b1e1a63ca46d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.022688] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0a65329a-ec17-411d-b432-b1e1a63ca46d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.022688] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0a65329a-ec17-411d-b432-b1e1a63ca46d',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.045032] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.045219] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.045295] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.045465] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.045557] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.045657] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e2f14ed1-21b8-4d1e-b6bc-559e167b9967 is going to be updated. [ 686.073171] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.073482] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.073482] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.073770] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.073770] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.083291] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e2f14ed1-21b8-4d1e-b6bc-559e167b9967 in Status: IN_PROGRESS for 2s [ 686.527032] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0a65329a-ec17-411d-b432-b1e1a63ca46d with status ACTIVE [ 686.527032] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.527032] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.527032] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.527032] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.527032] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.527032] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.527032] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.527032] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.527032] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.527032] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.527032] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.527032] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.527032] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.527032] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.527032] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.527032] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0a65329a-ec17-411d-b432-b1e1a63ca46d is going to be updated. [ 686.552569] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.553834] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.553834] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.553834] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.553834] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.553834] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0a65329a-ec17-411d-b432-b1e1a63ca46d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.559209] env[69188]: INFO networking_nsxv3.common.synchronization [req-001f91e4-b663-4ff3-b571-01d05d2f4466 req-f2dc0f28-7e79-4c5e-b371-743d0022c90a tempest-ServerRescueTestJSON-1501419910 tempest-ServerRescueTestJSON-1501419910-project-member] Enqueued Resource ID: 143fbb10-efe2-4f17-a012-d41cc9b595b6 with Priority: HIGHEST for action security_group_members [ 686.559209] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 143fbb10-efe2-4f17-a012-d41cc9b595b6 with Priority: HIGHEST for action security_group_members [ 686.559209] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-143fbb10-efe2-4f17-a012-d41cc9b595b6 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.559209] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-143fbb10-efe2-4f17-a012-d41cc9b595b6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.559209] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-143fbb10-efe2-4f17-a012-d41cc9b595b6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.559209] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-143fbb10-efe2-4f17-a012-d41cc9b595b6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.559209] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.559209] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.559209] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.559714] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.559890] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.560089] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('143fbb10-efe2-4f17-a012-d41cc9b595b6',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.563175] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b8569476-f644-46f4-87dc-5a1d19af31a2 in Status: SUCCESS [ 686.563585] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b8569476-f644-46f4-87dc-5a1d19af31a2" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.063777] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.063911] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.063966] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.064266] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.064768] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.064768] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.064768] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.064768] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.065211] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.065211] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.065211] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 143fbb10-efe2-4f17-a012-d41cc9b595b6 already deleted. [ 687.065211] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-143fbb10-efe2-4f17-a012-d41cc9b595b6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.241334] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock network-657 taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.241334] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "network-657" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.241334] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "network-657" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.241334] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "network-657" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.242273] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.242431] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.242579] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.242800] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.242993] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.243321] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 687.243713] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] NeedRegenerationException {{(pid=69188) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 687.243983] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] no value, waiting for create lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 687.244330] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] value creation lock acquired {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 687.244330] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 687.244476] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Calling creation function for not-yet-present value {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 687.244767] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 687.262229] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 687.262440] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69188) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 687.262528] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Released creation lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 687.262809] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "network-657" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.263069] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock port-8094f273-88cf-440b-92e4-954daf62d527 taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.263251] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "port-8094f273-88cf-440b-92e4-954daf62d527" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.263661] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "port-8094f273-88cf-440b-92e4-954daf62d527" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.263875] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "port-8094f273-88cf-440b-92e4-954daf62d527" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.264080] env[69188]: DEBUG networking_nsxv3.api.rpc [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8094f273-88cf-440b-92e4-954daf62d527',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.767523] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.767930] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.767930] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.768306] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.768378] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.768511] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Segment Port 8094f273-88cf-440b-92e4-954daf62d527 not found, creating... [ 687.768885] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.769038] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.769038] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.769285] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.769435] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.769722] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.769880] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.769996] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.772165] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.772321] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.772520] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Resource: SegmentPort with ID: 8094f273-88cf-440b-92e4-954daf62d527 is going to be created. [ 687.796861] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.797076] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.797204] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.797495] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.797745] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.798062] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "port-8094f273-88cf-440b-92e4-954daf62d527" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.097202] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e2f14ed1-21b8-4d1e-b6bc-559e167b9967 in Status: SUCCESS [ 688.097202] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2f14ed1-21b8-4d1e-b6bc-559e167b9967" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.097374] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2f14ed1-21b8-4d1e-b6bc-559e167b9967" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.097636] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2f14ed1-21b8-4d1e-b6bc-559e167b9967" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.097850] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.097968] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.098044] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.098201] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.098291] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.098376] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2f14ed1-21b8-4d1e-b6bc-559e167b9967" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.099507] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2f14ed1-21b8-4d1e-b6bc-559e167b9967 taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.099507] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2f14ed1-21b8-4d1e-b6bc-559e167b9967" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.099507] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2f14ed1-21b8-4d1e-b6bc-559e167b9967" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.099507] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2f14ed1-21b8-4d1e-b6bc-559e167b9967" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.099507] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.104021] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.104021] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.104021] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.104021] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.104021] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2f14ed1-21b8-4d1e-b6bc-559e167b9967" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.104021] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e2f14ed1-21b8-4d1e-b6bc-559e167b9967',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.104021] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2f14ed1-21b8-4d1e-b6bc-559e167b9967" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.104021] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2f14ed1-21b8-4d1e-b6bc-559e167b9967" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.104021] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.104021] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.104021] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.104021] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.104021] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.104021] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e2f14ed1-21b8-4d1e-b6bc-559e167b9967',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.579337] env[69188]: INFO networking_nsxv3.common.synchronization [None req-ae8624e1-9130-430f-97df-1672d692eece None None] Enqueued Resource ID: 0fb89992-ff2b-4fee-8f65-3e8633f85ef7 with Priority: HIGHEST for action port [ 688.579337] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0fb89992-ff2b-4fee-8f65-3e8633f85ef7 with Priority: HIGHEST for action port [ 688.579337] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-0fb89992-ff2b-4fee-8f65-3e8633f85ef7 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.579337] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0fb89992-ff2b-4fee-8f65-3e8633f85ef7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.579337] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0fb89992-ff2b-4fee-8f65-3e8633f85ef7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.579337] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0fb89992-ff2b-4fee-8f65-3e8633f85ef7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.579337] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0fb89992-ff2b-4fee-8f65-3e8633f85ef7',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.605419] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e2f14ed1-21b8-4d1e-b6bc-559e167b9967',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.607388] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e2f14ed1-21b8-4d1e-b6bc-559e167b9967: rpc.has_security_group_logging(os_id): False [ 688.628633] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.628758] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.628825] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.629076] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.629158] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.629373] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.629932] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.629932] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.629932] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.629932] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.630133] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.630133] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.630133] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.630266] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.630333] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.630521] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.631173] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.631173] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.631173] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.631173] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.631173] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e2f14ed1-21b8-4d1e-b6bc-559e167b9967 is going to be created. [ 688.685840] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.685996] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.686076] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.686297] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.686520] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.696709] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e2f14ed1-21b8-4d1e-b6bc-559e167b9967 in Status: IN_PROGRESS for 2s [ 689.081776] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0fb89992-ff2b-4fee-8f65-3e8633f85ef7 [ 689.082038] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.082166] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.082240] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.082457] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.082551] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.082647] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0fb89992-ff2b-4fee-8f65-3e8633f85ef7 already deleted. [ 689.082728] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0fb89992-ff2b-4fee-8f65-3e8633f85ef7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.110518] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e2f14ed1-21b8-4d1e-b6bc-559e167b9967',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.613540] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.613704] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.613776] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.613991] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.614099] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.614199] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e2f14ed1-21b8-4d1e-b6bc-559e167b9967 is going to be updated. [ 689.640306] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.640306] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.640527] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.640569] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.640691] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.653019] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e2f14ed1-21b8-4d1e-b6bc-559e167b9967 in Status: IN_PROGRESS for 2s [ 689.784906] env[69188]: INFO networking_nsxv3.common.synchronization [req-d67832cb-2f49-455b-9f25-6e5cbc4bb672 req-9f8151b4-53f4-4986-909e-7ecee0af4569 tempest-ServersTestJSON-1227074238 tempest-ServersTestJSON-1227074238-project-member] Enqueued Resource ID: 55dcb887-f0db-4969-b757-e829798327eb with Priority: HIGHEST for action security_group_members [ 689.785366] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55dcb887-f0db-4969-b757-e829798327eb with Priority: HIGHEST for action security_group_members [ 689.785674] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-55dcb887-f0db-4969-b757-e829798327eb taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.785793] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55dcb887-f0db-4969-b757-e829798327eb" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.785851] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55dcb887-f0db-4969-b757-e829798327eb" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.789663] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55dcb887-f0db-4969-b757-e829798327eb" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.789663] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.789663] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.789663] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.789663] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.789663] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.789949] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('55dcb887-f0db-4969-b757-e829798327eb',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.797322] env[69188]: INFO networking_nsxv3.common.synchronization [req-001f91e4-b663-4ff3-b571-01d05d2f4466 req-959c38ec-b1fb-41cc-b4a8-04869e16f389 service nova] Enqueued Resource ID: 143fbb10-efe2-4f17-a012-d41cc9b595b6 with Priority: HIGHEST for action security_group_rules [ 689.797322] env[69188]: INFO networking_nsxv3.common.synchronization [req-001f91e4-b663-4ff3-b571-01d05d2f4466 req-959c38ec-b1fb-41cc-b4a8-04869e16f389 service nova] Enqueued Resource ID: 143fbb10-efe2-4f17-a012-d41cc9b595b6 with Priority: HIGHEST for action security_group_members [ 689.797322] env[69188]: INFO networking_nsxv3.common.synchronization [req-001f91e4-b663-4ff3-b571-01d05d2f4466 req-959c38ec-b1fb-41cc-b4a8-04869e16f389 service nova] Enqueued Resource ID: 8094f273-88cf-440b-92e4-954daf62d527 with Priority: HIGHEST for action port [ 689.797322] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 143fbb10-efe2-4f17-a012-d41cc9b595b6 with Priority: HIGHEST for action security_group_rules [ 689.797322] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 143fbb10-efe2-4f17-a012-d41cc9b595b6 with Priority: HIGHEST for action security_group_members [ 689.797322] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8094f273-88cf-440b-92e4-954daf62d527 with Priority: HIGHEST for action port [ 689.797787] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-143fbb10-efe2-4f17-a012-d41cc9b595b6 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.797787] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-143fbb10-efe2-4f17-a012-d41cc9b595b6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.797787] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-143fbb10-efe2-4f17-a012-d41cc9b595b6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.798141] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-143fbb10-efe2-4f17-a012-d41cc9b595b6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.798141] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('143fbb10-efe2-4f17-a012-d41cc9b595b6',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.798930] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-143fbb10-efe2-4f17-a012-d41cc9b595b6 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.799051] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-143fbb10-efe2-4f17-a012-d41cc9b595b6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.799118] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-143fbb10-efe2-4f17-a012-d41cc9b595b6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.799283] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-143fbb10-efe2-4f17-a012-d41cc9b595b6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.799423] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.799513] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.799571] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.799702] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.799779] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.799861] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('143fbb10-efe2-4f17-a012-d41cc9b595b6',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.800585] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-8094f273-88cf-440b-92e4-954daf62d527 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.800700] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8094f273-88cf-440b-92e4-954daf62d527" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.800746] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8094f273-88cf-440b-92e4-954daf62d527" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.801090] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8094f273-88cf-440b-92e4-954daf62d527" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.801090] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8094f273-88cf-440b-92e4-954daf62d527',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.293151] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.293435] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.293435] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.293609] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.293681] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.293875] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.293970] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.294048] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.294201] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.294279] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.294368] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 55dcb887-f0db-4969-b757-e829798327eb is going to be updated. [ 690.304295] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('143fbb10-efe2-4f17-a012-d41cc9b595b6',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.305430] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-143fbb10-efe2-4f17-a012-d41cc9b595b6 taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.329833] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-143fbb10-efe2-4f17-a012-d41cc9b595b6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.329833] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8094f273-88cf-440b-92e4-954daf62d527 with status ACTIVE [ 690.329833] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.329833] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.329833] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.329833] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.329833] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.329833] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.329833] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.329833] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.329833] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.329833] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.329833] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.329833] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.329833] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.329833] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.329833] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.332086] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8094f273-88cf-440b-92e4-954daf62d527 is going to be updated. [ 690.332086] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.332086] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.332086] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.332086] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.332086] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.335649] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.335752] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.335752] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.336423] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.336423] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.336423] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8094f273-88cf-440b-92e4-954daf62d527" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.346191] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 55dcb887-f0db-4969-b757-e829798327eb in Status: IN_PROGRESS for 2s [ 690.712149] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e2f14ed1-21b8-4d1e-b6bc-559e167b9967 in Status: SUCCESS [ 690.713744] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e2f14ed1-21b8-4d1e-b6bc-559e167b9967" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.713744] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e2f14ed1-21b8-4d1e-b6bc-559e167b9967" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.713744] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e2f14ed1-21b8-4d1e-b6bc-559e167b9967" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.713744] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e2f14ed1-21b8-4d1e-b6bc-559e167b9967',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.813558] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('143fbb10-efe2-4f17-a012-d41cc9b595b6',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.942771] env[69188]: INFO networking_nsxv3.common.synchronization [None req-165f1e5d-1b33-4dca-855e-80f903fdcab5 None None] Enqueued Resource ID: de61c3b5-bbef-498c-9773-b12dcd8c5e85 with Priority: HIGHEST for action port [ 690.943054] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: de61c3b5-bbef-498c-9773-b12dcd8c5e85 with Priority: HIGHEST for action port [ 690.943638] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-de61c3b5-bbef-498c-9773-b12dcd8c5e85 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.943766] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-de61c3b5-bbef-498c-9773-b12dcd8c5e85" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.943836] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-de61c3b5-bbef-498c-9773-b12dcd8c5e85" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.945345] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-de61c3b5-bbef-498c-9773-b12dcd8c5e85" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.945496] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('de61c3b5-bbef-498c-9773-b12dcd8c5e85',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.217154] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2f14ed1-21b8-4d1e-b6bc-559e167b9967 taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.217154] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2f14ed1-21b8-4d1e-b6bc-559e167b9967" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.317191] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.317458] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.317458] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.317624] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.317714] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.317947] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 143fbb10-efe2-4f17-a012-d41cc9b595b6 is going to be created. [ 691.340758] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.340758] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.340905] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.340992] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.341169] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.352708] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 143fbb10-efe2-4f17-a012-d41cc9b595b6 in Status: UNINITIALIZED for 2s [ 691.447713] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port de61c3b5-bbef-498c-9773-b12dcd8c5e85 [ 691.447809] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.448132] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.448132] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.448256] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.449164] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.449164] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:de61c3b5-bbef-498c-9773-b12dcd8c5e85 already deleted. [ 691.449164] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-de61c3b5-bbef-498c-9773-b12dcd8c5e85" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.665031] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e2f14ed1-21b8-4d1e-b6bc-559e167b9967 in Status: IN_PROGRESS for 4s [ 692.356367] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 55dcb887-f0db-4969-b757-e829798327eb in Status: SUCCESS [ 692.356367] env[69188]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 55dcb887-f0db-4969-b757-e829798327eb deletion is rescheduled due to dependency. [ 692.356367] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55dcb887-f0db-4969-b757-e829798327eb" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.632195] env[69188]: INFO networking_nsxv3.common.synchronization [None req-5622a3f2-9564-42a9-bb89-1baed0c2d72e None None] Enqueued Resource ID: f5c4af5c-cfdc-4dc1-85d3-f666b7dbfca1 with Priority: HIGHEST for action port [ 692.632408] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f5c4af5c-cfdc-4dc1-85d3-f666b7dbfca1 with Priority: HIGHEST for action port [ 692.633014] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-f5c4af5c-cfdc-4dc1-85d3-f666b7dbfca1 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.633203] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f5c4af5c-cfdc-4dc1-85d3-f666b7dbfca1" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.633334] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f5c4af5c-cfdc-4dc1-85d3-f666b7dbfca1" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.634021] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f5c4af5c-cfdc-4dc1-85d3-f666b7dbfca1" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.634021] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f5c4af5c-cfdc-4dc1-85d3-f666b7dbfca1',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.138396] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f5c4af5c-cfdc-4dc1-85d3-f666b7dbfca1 [ 693.139696] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.139988] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.140176] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.141169] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.141380] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.141648] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f5c4af5c-cfdc-4dc1-85d3-f666b7dbfca1 already deleted. [ 693.141862] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f5c4af5c-cfdc-4dc1-85d3-f666b7dbfca1" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.365022] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 143fbb10-efe2-4f17-a012-d41cc9b595b6 in Status: SUCCESS [ 693.365022] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-143fbb10-efe2-4f17-a012-d41cc9b595b6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.365022] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-143fbb10-efe2-4f17-a012-d41cc9b595b6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.365022] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-143fbb10-efe2-4f17-a012-d41cc9b595b6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.365022] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.365022] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.365022] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.365022] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.365022] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.365022] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-143fbb10-efe2-4f17-a012-d41cc9b595b6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.365022] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('143fbb10-efe2-4f17-a012-d41cc9b595b6',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.559855] env[69188]: INFO networking_nsxv3.common.synchronization [req-a3dc2ee5-1e59-4af5-951b-b94294d7523d req-cade18af-0010-4012-b17d-fab06d16e45c tempest-ImagesOneServerTestJSON-1309400868 tempest-ImagesOneServerTestJSON-1309400868-project-member] Enqueued Resource ID: 614b9fd7-ab13-4673-ace1-c5f03c5b9acc with Priority: HIGHEST for action security_group_members [ 693.560401] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 614b9fd7-ab13-4673-ace1-c5f03c5b9acc with Priority: HIGHEST for action security_group_members [ 693.561121] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-614b9fd7-ab13-4673-ace1-c5f03c5b9acc taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.561287] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-614b9fd7-ab13-4673-ace1-c5f03c5b9acc" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.561368] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-614b9fd7-ab13-4673-ace1-c5f03c5b9acc" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.561579] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-614b9fd7-ab13-4673-ace1-c5f03c5b9acc" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.561736] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.561836] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.561892] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.562043] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.562224] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.562224] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('614b9fd7-ab13-4673-ace1-c5f03c5b9acc',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.669405] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e2f14ed1-21b8-4d1e-b6bc-559e167b9967 in Status: SUCCESS [ 693.669626] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2f14ed1-21b8-4d1e-b6bc-559e167b9967" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.669789] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2f14ed1-21b8-4d1e-b6bc-559e167b9967" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.670014] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2f14ed1-21b8-4d1e-b6bc-559e167b9967" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.670208] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.670327] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.670390] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.670557] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.670635] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.670717] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2f14ed1-21b8-4d1e-b6bc-559e167b9967" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.670827] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e2f14ed1-21b8-4d1e-b6bc-559e167b9967',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.868989] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-143fbb10-efe2-4f17-a012-d41cc9b595b6 taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.869162] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-143fbb10-efe2-4f17-a012-d41cc9b595b6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.869899] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-143fbb10-efe2-4f17-a012-d41cc9b595b6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.869899] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-143fbb10-efe2-4f17-a012-d41cc9b595b6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.869899] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.869899] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.869899] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.869899] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.870163] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.870163] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-143fbb10-efe2-4f17-a012-d41cc9b595b6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.870218] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-143fbb10-efe2-4f17-a012-d41cc9b595b6 taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.870284] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-143fbb10-efe2-4f17-a012-d41cc9b595b6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.870366] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-143fbb10-efe2-4f17-a012-d41cc9b595b6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.870478] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-143fbb10-efe2-4f17-a012-d41cc9b595b6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.870614] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.870704] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.870763] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.870898] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.870976] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.871152] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-143fbb10-efe2-4f17-a012-d41cc9b595b6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.871260] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('143fbb10-efe2-4f17-a012-d41cc9b595b6',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.064174] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.064287] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.064362] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.064681] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.064681] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.065054] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.065226] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.065320] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.065919] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.066058] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.066197] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 614b9fd7-ab13-4673-ace1-c5f03c5b9acc is going to be updated. [ 694.093763] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.093967] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.094025] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.094195] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.094333] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.103117] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 614b9fd7-ab13-4673-ace1-c5f03c5b9acc in Status: IN_PROGRESS for 2s [ 694.177273] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2f14ed1-21b8-4d1e-b6bc-559e167b9967 taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.177273] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2f14ed1-21b8-4d1e-b6bc-559e167b9967" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.177273] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2f14ed1-21b8-4d1e-b6bc-559e167b9967" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.177273] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2f14ed1-21b8-4d1e-b6bc-559e167b9967" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.177273] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.177273] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.177273] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.177273] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.177273] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.177273] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2f14ed1-21b8-4d1e-b6bc-559e167b9967" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.177273] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2f14ed1-21b8-4d1e-b6bc-559e167b9967 taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.177273] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2f14ed1-21b8-4d1e-b6bc-559e167b9967" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.177273] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2f14ed1-21b8-4d1e-b6bc-559e167b9967" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.177273] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2f14ed1-21b8-4d1e-b6bc-559e167b9967" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.177273] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.177273] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.177711] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.177711] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.177711] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.177711] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2f14ed1-21b8-4d1e-b6bc-559e167b9967" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.177711] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e2f14ed1-21b8-4d1e-b6bc-559e167b9967',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.375270] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 143fbb10-efe2-4f17-a012-d41cc9b595b6: rpc.has_security_group_logging(os_id): False [ 694.392669] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.392822] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.392895] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.393136] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.393231] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.393426] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.393528] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.393704] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.393766] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.393809] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.394014] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.394113] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.394180] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.394323] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.394399] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.394619] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.394715] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.394715] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.394849] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.394924] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.395018] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 143fbb10-efe2-4f17-a012-d41cc9b595b6 is going to be created. [ 694.475680] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.475846] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.476023] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.476158] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.476437] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.491094] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 143fbb10-efe2-4f17-a012-d41cc9b595b6 in Status: IN_PROGRESS for 2s [ 694.605827] env[69188]: INFO networking_nsxv3.common.synchronization [req-aca8b992-a16e-495f-aadb-7531caea8b8e req-0bd2e98c-3abd-4f9a-9aa3-fcbd26d6dca4 tempest-ListServerFiltersTestJSON-1426102960 tempest-ListServerFiltersTestJSON-1426102960-project-member] Enqueued Resource ID: e2f14ed1-21b8-4d1e-b6bc-559e167b9967 with Priority: HIGHEST for action security_group_members [ 694.606469] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2f14ed1-21b8-4d1e-b6bc-559e167b9967 with Priority: HIGHEST for action security_group_members [ 694.606972] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2f14ed1-21b8-4d1e-b6bc-559e167b9967 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.607242] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2f14ed1-21b8-4d1e-b6bc-559e167b9967" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.607419] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2f14ed1-21b8-4d1e-b6bc-559e167b9967" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.607739] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2f14ed1-21b8-4d1e-b6bc-559e167b9967" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.607977] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.609629] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.609629] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.609629] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.609629] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.609629] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e2f14ed1-21b8-4d1e-b6bc-559e167b9967',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.681037] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e2f14ed1-21b8-4d1e-b6bc-559e167b9967: rpc.has_security_group_logging(os_id): False [ 694.701217] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.701217] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.701217] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.701446] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.701535] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.701747] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.701847] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.701910] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.702080] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.702164] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.702353] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.702453] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.702493] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.702630] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.702707] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.702904] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.702987] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.704030] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.704168] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.704313] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.704431] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e2f14ed1-21b8-4d1e-b6bc-559e167b9967 is going to be updated. [ 694.787331] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.790642] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.790642] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.790642] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.790791] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.807887] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e2f14ed1-21b8-4d1e-b6bc-559e167b9967 in Status: IN_PROGRESS for 2s [ 695.112127] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e2f14ed1-21b8-4d1e-b6bc-559e167b9967',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.360623] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock network-599 taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.360743] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "network-599" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.360818] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "network-599" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.361244] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "network-599" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.361353] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.361508] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.361621] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.361827] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.361969] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.362211] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 695.362353] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] NeedRegenerationException {{(pid=69188) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 695.362435] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] no value, waiting for create lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 695.362539] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] value creation lock acquired {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 695.362644] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 695.362746] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Calling creation function for not-yet-present value {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 695.362872] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 695.382933] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 695.383235] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69188) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 695.383516] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Released creation lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 695.383516] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "network-599" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.384163] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock port-fa618c9d-45d1-44a6-b008-fb486e3ef5a4 taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.384384] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "port-fa618c9d-45d1-44a6-b008-fb486e3ef5a4" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.384472] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "port-fa618c9d-45d1-44a6-b008-fb486e3ef5a4" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.384801] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "port-fa618c9d-45d1-44a6-b008-fb486e3ef5a4" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.384943] env[69188]: DEBUG networking_nsxv3.api.rpc [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fa618c9d-45d1-44a6-b008-fb486e3ef5a4',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.474013] env[69188]: INFO networking_nsxv3.common.synchronization [None req-42cd4412-9613-4adf-b2dc-dd62df06a07e None None] Enqueued Resource ID: 4b520445-282c-44cc-ab0f-cf46cb89ad12 with Priority: HIGHEST for action port [ 695.474312] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4b520445-282c-44cc-ab0f-cf46cb89ad12 with Priority: HIGHEST for action port [ 695.475118] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-4b520445-282c-44cc-ab0f-cf46cb89ad12 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.475118] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4b520445-282c-44cc-ab0f-cf46cb89ad12" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.475118] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4b520445-282c-44cc-ab0f-cf46cb89ad12" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.475359] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4b520445-282c-44cc-ab0f-cf46cb89ad12" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.475433] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4b520445-282c-44cc-ab0f-cf46cb89ad12',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.618275] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e2f14ed1-21b8-4d1e-b6bc-559e167b9967',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.887408] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.887654] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.887797] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.888102] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.888257] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.888608] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Segment Port fa618c9d-45d1-44a6-b008-fb486e3ef5a4 not found, creating... [ 695.888655] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.888808] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.889022] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.889691] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.889691] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.889691] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.889856] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.889898] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.890341] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.890487] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.890663] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Resource: SegmentPort with ID: fa618c9d-45d1-44a6-b008-fb486e3ef5a4 is going to be created. [ 695.910802] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.911458] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.911458] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.911458] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.911636] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.911854] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "port-fa618c9d-45d1-44a6-b008-fb486e3ef5a4" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.984271] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4b520445-282c-44cc-ab0f-cf46cb89ad12 [ 695.984271] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.984271] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.984271] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.984271] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.984271] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.984271] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4b520445-282c-44cc-ab0f-cf46cb89ad12 already deleted. [ 695.984271] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4b520445-282c-44cc-ab0f-cf46cb89ad12" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.113823] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 614b9fd7-ab13-4673-ace1-c5f03c5b9acc in Status: SUCCESS [ 696.115396] env[69188]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 614b9fd7-ab13-4673-ace1-c5f03c5b9acc deletion is rescheduled due to dependency. [ 696.115396] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-614b9fd7-ab13-4673-ace1-c5f03c5b9acc" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.124658] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.124658] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.124658] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.124658] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.124658] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.124658] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e2f14ed1-21b8-4d1e-b6bc-559e167b9967 is going to be updated. [ 696.152246] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.152488] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.152488] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.153943] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.153943] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.162394] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e2f14ed1-21b8-4d1e-b6bc-559e167b9967 in Status: IN_PROGRESS for 2s [ 696.504488] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 143fbb10-efe2-4f17-a012-d41cc9b595b6 in Status: SUCCESS [ 696.504793] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-143fbb10-efe2-4f17-a012-d41cc9b595b6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.738889] env[69188]: INFO networking_nsxv3.common.synchronization [req-9f088dcb-dfe2-494e-ae11-68815cf06a0e req-f73cbe62-fdb6-4c60-b6a7-75308a0d939e tempest-ServersAdminNegativeTestJSON-68746947 tempest-ServersAdminNegativeTestJSON-68746947-project-member] Enqueued Resource ID: b8569476-f644-46f4-87dc-5a1d19af31a2 with Priority: HIGHEST for action security_group_members [ 696.739832] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8569476-f644-46f4-87dc-5a1d19af31a2 with Priority: HIGHEST for action security_group_members [ 696.742041] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8569476-f644-46f4-87dc-5a1d19af31a2 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.742041] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8569476-f644-46f4-87dc-5a1d19af31a2" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.742041] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8569476-f644-46f4-87dc-5a1d19af31a2" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.742041] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8569476-f644-46f4-87dc-5a1d19af31a2" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.742041] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.742041] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.742041] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.742041] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.742041] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.742041] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b8569476-f644-46f4-87dc-5a1d19af31a2',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.821751] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e2f14ed1-21b8-4d1e-b6bc-559e167b9967 in Status: SUCCESS [ 696.821831] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e2f14ed1-21b8-4d1e-b6bc-559e167b9967" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.028272] env[69188]: INFO networking_nsxv3.common.synchronization [req-aca8b992-a16e-495f-aadb-7531caea8b8e req-5c0aff9a-8d93-4feb-9463-200748ff85b2 service nova] Enqueued Resource ID: e2f14ed1-21b8-4d1e-b6bc-559e167b9967 with Priority: HIGHEST for action security_group_rules [ 697.028272] env[69188]: INFO networking_nsxv3.common.synchronization [req-aca8b992-a16e-495f-aadb-7531caea8b8e req-5c0aff9a-8d93-4feb-9463-200748ff85b2 service nova] Enqueued Resource ID: e2f14ed1-21b8-4d1e-b6bc-559e167b9967 with Priority: HIGHEST for action security_group_members [ 697.028272] env[69188]: INFO networking_nsxv3.common.synchronization [req-aca8b992-a16e-495f-aadb-7531caea8b8e req-5c0aff9a-8d93-4feb-9463-200748ff85b2 service nova] Enqueued Resource ID: fa618c9d-45d1-44a6-b008-fb486e3ef5a4 with Priority: HIGHEST for action port [ 697.028272] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2f14ed1-21b8-4d1e-b6bc-559e167b9967 with Priority: HIGHEST for action security_group_rules [ 697.028272] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2f14ed1-21b8-4d1e-b6bc-559e167b9967 with Priority: HIGHEST for action security_group_members [ 697.028272] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fa618c9d-45d1-44a6-b008-fb486e3ef5a4 with Priority: HIGHEST for action port [ 697.028272] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e2f14ed1-21b8-4d1e-b6bc-559e167b9967 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.028272] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e2f14ed1-21b8-4d1e-b6bc-559e167b9967" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.028272] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e2f14ed1-21b8-4d1e-b6bc-559e167b9967" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.029064] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e2f14ed1-21b8-4d1e-b6bc-559e167b9967" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.029286] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e2f14ed1-21b8-4d1e-b6bc-559e167b9967',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.030506] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2f14ed1-21b8-4d1e-b6bc-559e167b9967 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.030694] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2f14ed1-21b8-4d1e-b6bc-559e167b9967" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.031050] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-fa618c9d-45d1-44a6-b008-fb486e3ef5a4 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.031264] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fa618c9d-45d1-44a6-b008-fb486e3ef5a4" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.031398] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fa618c9d-45d1-44a6-b008-fb486e3ef5a4" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.033709] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fa618c9d-45d1-44a6-b008-fb486e3ef5a4" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.033709] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fa618c9d-45d1-44a6-b008-fb486e3ef5a4',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.247873] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b8569476-f644-46f4-87dc-5a1d19af31a2',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.533995] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2f14ed1-21b8-4d1e-b6bc-559e167b9967 taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.534749] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2f14ed1-21b8-4d1e-b6bc-559e167b9967" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.535493] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fa618c9d-45d1-44a6-b008-fb486e3ef5a4 with status ACTIVE [ 697.535714] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.535838] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.535933] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.536205] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.536293] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.536410] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.536522] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.536988] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.536988] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.536988] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.537105] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.537615] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.537615] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.537615] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.537615] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.537769] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fa618c9d-45d1-44a6-b008-fb486e3ef5a4 is going to be updated. [ 697.559570] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.559761] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.559837] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.560060] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.560222] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.560402] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fa618c9d-45d1-44a6-b008-fb486e3ef5a4" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.751256] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b8569476-f644-46f4-87dc-5a1d19af31a2',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.978342] env[69188]: INFO networking_nsxv3.common.synchronization [None req-c4cc66d4-f273-40b0-9cde-bd67e5962563 None None] Enqueued Resource ID: 07044d1c-7fdb-4aa2-825b-d42143bc4e07 with Priority: HIGHEST for action port [ 697.978536] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 07044d1c-7fdb-4aa2-825b-d42143bc4e07 with Priority: HIGHEST for action port [ 697.978805] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-07044d1c-7fdb-4aa2-825b-d42143bc4e07 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.978949] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-07044d1c-7fdb-4aa2-825b-d42143bc4e07" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.979060] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-07044d1c-7fdb-4aa2-825b-d42143bc4e07" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.979509] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-07044d1c-7fdb-4aa2-825b-d42143bc4e07" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.979509] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('07044d1c-7fdb-4aa2-825b-d42143bc4e07',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.172714] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e2f14ed1-21b8-4d1e-b6bc-559e167b9967 in Status: SUCCESS [ 698.172949] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2f14ed1-21b8-4d1e-b6bc-559e167b9967" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.173145] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2f14ed1-21b8-4d1e-b6bc-559e167b9967" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.173363] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2f14ed1-21b8-4d1e-b6bc-559e167b9967" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.177214] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.179254] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.179254] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.179254] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.179254] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.179254] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e2f14ed1-21b8-4d1e-b6bc-559e167b9967',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.255097] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.255295] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.255372] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.255634] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.255733] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.257559] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b8569476-f644-46f4-87dc-5a1d19af31a2 is going to be updated. [ 698.289037] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.289037] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.289037] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.289037] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.289037] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.297420] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b8569476-f644-46f4-87dc-5a1d19af31a2 in Status: IN_PROGRESS for 2s [ 698.481664] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 07044d1c-7fdb-4aa2-825b-d42143bc4e07 [ 698.481905] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.482127] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.484211] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.484211] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.484211] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.484211] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:07044d1c-7fdb-4aa2-825b-d42143bc4e07 already deleted. [ 698.484211] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-07044d1c-7fdb-4aa2-825b-d42143bc4e07" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.680589] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e2f14ed1-21b8-4d1e-b6bc-559e167b9967',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.183400] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e2f14ed1-21b8-4d1e-b6bc-559e167b9967',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.687844] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.687844] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.687844] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.687844] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.687844] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.687844] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e2f14ed1-21b8-4d1e-b6bc-559e167b9967 is going to be updated. [ 699.716850] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.716850] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.716994] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.717317] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.717541] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.737810] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e2f14ed1-21b8-4d1e-b6bc-559e167b9967 in Status: IN_PROGRESS for 2s [ 700.289155] env[69188]: INFO networking_nsxv3.common.synchronization [req-c34cb2ba-b372-4817-8fe3-41ffaa492327 req-4d84f3d7-2226-460a-a38e-d4f254dc68c4 tempest-AttachInterfacesV270Test-753387423 tempest-AttachInterfacesV270Test-753387423-project-member] Enqueued Resource ID: c019210a-f261-4200-a6cd-a6e2fc4f9396 with Priority: HIGHEST for action security_group_members [ 700.289155] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c019210a-f261-4200-a6cd-a6e2fc4f9396 with Priority: HIGHEST for action security_group_members [ 700.289155] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-c019210a-f261-4200-a6cd-a6e2fc4f9396 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.289155] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c019210a-f261-4200-a6cd-a6e2fc4f9396" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.289155] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c019210a-f261-4200-a6cd-a6e2fc4f9396" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.289155] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c019210a-f261-4200-a6cd-a6e2fc4f9396" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.289155] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.289717] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.289869] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.290115] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.290278] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.290438] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c019210a-f261-4200-a6cd-a6e2fc4f9396',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.313753] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b8569476-f644-46f4-87dc-5a1d19af31a2 in Status: SUCCESS [ 700.314156] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8569476-f644-46f4-87dc-5a1d19af31a2" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.794279] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.794279] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.794279] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.794279] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.794279] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.794279] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.794279] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.794279] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.794279] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.794279] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.794279] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c019210a-f261-4200-a6cd-a6e2fc4f9396 already deleted. [ 700.794279] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c019210a-f261-4200-a6cd-a6e2fc4f9396" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.082951] env[69188]: INFO networking_nsxv3.common.synchronization [None req-96613aed-25af-45d9-870d-1791d07b70c0 None None] Enqueued Resource ID: a4efc82a-563a-48e8-8286-b48dd22c883f with Priority: HIGHEST for action port [ 701.082951] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a4efc82a-563a-48e8-8286-b48dd22c883f with Priority: HIGHEST for action port [ 701.082951] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-a4efc82a-563a-48e8-8286-b48dd22c883f taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.082951] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a4efc82a-563a-48e8-8286-b48dd22c883f" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.082951] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a4efc82a-563a-48e8-8286-b48dd22c883f" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.083300] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a4efc82a-563a-48e8-8286-b48dd22c883f" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.083300] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a4efc82a-563a-48e8-8286-b48dd22c883f',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.264230] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock network-453 taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.264230] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "network-453" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.264230] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "network-453" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.264230] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "network-453" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.264230] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.264230] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.264230] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.264230] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.264230] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.265417] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 701.267910] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] NeedRegenerationException {{(pid=69188) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 701.267910] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] no value, waiting for create lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 701.267910] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] value creation lock acquired {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 701.267910] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 701.267910] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Calling creation function for not-yet-present value {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 701.267910] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 701.287038] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 701.287038] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69188) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 701.287038] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Released creation lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 701.287038] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "network-453" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.287038] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock port-e50a13ae-126a-4814-bc46-eccfa7ba7182 taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.287038] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "port-e50a13ae-126a-4814-bc46-eccfa7ba7182" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.287038] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "port-e50a13ae-126a-4814-bc46-eccfa7ba7182" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.287038] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "port-e50a13ae-126a-4814-bc46-eccfa7ba7182" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.287648] env[69188]: DEBUG networking_nsxv3.api.rpc [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e50a13ae-126a-4814-bc46-eccfa7ba7182',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.592748] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a4efc82a-563a-48e8-8286-b48dd22c883f [ 701.592986] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.593143] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.593211] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.593418] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.593506] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.593600] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a4efc82a-563a-48e8-8286-b48dd22c883f already deleted. [ 701.593684] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a4efc82a-563a-48e8-8286-b48dd22c883f" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.750635] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e2f14ed1-21b8-4d1e-b6bc-559e167b9967 in Status: SUCCESS [ 701.750635] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2f14ed1-21b8-4d1e-b6bc-559e167b9967" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.750635] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2f14ed1-21b8-4d1e-b6bc-559e167b9967" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.750635] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2f14ed1-21b8-4d1e-b6bc-559e167b9967" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.750635] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.750635] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.750635] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.750635] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.750635] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.750635] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2f14ed1-21b8-4d1e-b6bc-559e167b9967" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.750635] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e2f14ed1-21b8-4d1e-b6bc-559e167b9967',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.791118] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.792295] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.792295] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.792295] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.792295] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.792295] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Segment Port e50a13ae-126a-4814-bc46-eccfa7ba7182 not found, creating... [ 701.792295] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.792650] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.792650] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.793712] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.793712] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.793712] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.793712] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.793712] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.793712] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.793936] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.793936] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Resource: SegmentPort with ID: e50a13ae-126a-4814-bc46-eccfa7ba7182 is going to be created. [ 701.812120] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.812514] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.812514] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.812839] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.812962] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.813206] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "port-e50a13ae-126a-4814-bc46-eccfa7ba7182" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.252730] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2f14ed1-21b8-4d1e-b6bc-559e167b9967 taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.252894] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2f14ed1-21b8-4d1e-b6bc-559e167b9967" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.252967] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2f14ed1-21b8-4d1e-b6bc-559e167b9967" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.253207] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2f14ed1-21b8-4d1e-b6bc-559e167b9967" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.253437] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.253578] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.253578] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.253679] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.253750] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.253841] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2f14ed1-21b8-4d1e-b6bc-559e167b9967" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.253985] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2f14ed1-21b8-4d1e-b6bc-559e167b9967 taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.254107] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2f14ed1-21b8-4d1e-b6bc-559e167b9967" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.254187] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2f14ed1-21b8-4d1e-b6bc-559e167b9967" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.254292] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2f14ed1-21b8-4d1e-b6bc-559e167b9967" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.254430] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.254525] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.254590] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.254744] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.254823] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.254907] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2f14ed1-21b8-4d1e-b6bc-559e167b9967" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.254999] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e2f14ed1-21b8-4d1e-b6bc-559e167b9967',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.757628] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e2f14ed1-21b8-4d1e-b6bc-559e167b9967: rpc.has_security_group_logging(os_id): False [ 702.775629] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.775784] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.775857] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.776090] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.776184] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.776378] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.776477] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.776540] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.776719] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.776807] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.776997] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.777115] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.777177] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.777318] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.777393] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.777623] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.777685] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.777770] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.777923] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.778000] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.778531] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e2f14ed1-21b8-4d1e-b6bc-559e167b9967 is going to be updated. [ 702.838840] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.839191] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.839191] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.839433] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.839616] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.854985] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e2f14ed1-21b8-4d1e-b6bc-559e167b9967 in Status: IN_PROGRESS for 2s [ 703.354014] env[69188]: INFO networking_nsxv3.common.synchronization [req-c34cb2ba-b372-4817-8fe3-41ffaa492327 req-528d735b-6c34-45a2-9dc2-8f3bdfa48bd0 service nova] Enqueued Resource ID: c019210a-f261-4200-a6cd-a6e2fc4f9396 with Priority: HIGHEST for action security_group_rules [ 703.354169] env[69188]: INFO networking_nsxv3.common.synchronization [req-c34cb2ba-b372-4817-8fe3-41ffaa492327 req-528d735b-6c34-45a2-9dc2-8f3bdfa48bd0 service nova] Enqueued Resource ID: c019210a-f261-4200-a6cd-a6e2fc4f9396 with Priority: HIGHEST for action security_group_members [ 703.354316] env[69188]: INFO networking_nsxv3.common.synchronization [req-c34cb2ba-b372-4817-8fe3-41ffaa492327 req-528d735b-6c34-45a2-9dc2-8f3bdfa48bd0 service nova] Enqueued Resource ID: e50a13ae-126a-4814-bc46-eccfa7ba7182 with Priority: HIGHEST for action port [ 703.354562] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c019210a-f261-4200-a6cd-a6e2fc4f9396 with Priority: HIGHEST for action security_group_rules [ 703.354714] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c019210a-f261-4200-a6cd-a6e2fc4f9396 with Priority: HIGHEST for action security_group_members [ 703.354944] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e50a13ae-126a-4814-bc46-eccfa7ba7182 with Priority: HIGHEST for action port [ 703.355371] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c019210a-f261-4200-a6cd-a6e2fc4f9396 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.355496] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c019210a-f261-4200-a6cd-a6e2fc4f9396" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.355563] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c019210a-f261-4200-a6cd-a6e2fc4f9396" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.357566] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c019210a-f261-4200-a6cd-a6e2fc4f9396" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.357566] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c019210a-f261-4200-a6cd-a6e2fc4f9396',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.358233] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-c019210a-f261-4200-a6cd-a6e2fc4f9396 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.358341] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c019210a-f261-4200-a6cd-a6e2fc4f9396" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.358405] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c019210a-f261-4200-a6cd-a6e2fc4f9396" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.358569] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c019210a-f261-4200-a6cd-a6e2fc4f9396" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.358736] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.358857] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.358919] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.359871] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.359871] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.359871] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c019210a-f261-4200-a6cd-a6e2fc4f9396',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.361570] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-e50a13ae-126a-4814-bc46-eccfa7ba7182 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.361570] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e50a13ae-126a-4814-bc46-eccfa7ba7182" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.361570] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e50a13ae-126a-4814-bc46-eccfa7ba7182" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.361570] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e50a13ae-126a-4814-bc46-eccfa7ba7182" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.361570] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e50a13ae-126a-4814-bc46-eccfa7ba7182',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.863548] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-c019210a-f261-4200-a6cd-a6e2fc4f9396 taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.863548] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c019210a-f261-4200-a6cd-a6e2fc4f9396" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.868208] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c019210a-f261-4200-a6cd-a6e2fc4f9396',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.868208] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e50a13ae-126a-4814-bc46-eccfa7ba7182 with status ACTIVE [ 703.868208] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.868208] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.868208] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.868208] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.868208] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.868208] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.868208] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.868208] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.868208] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.868208] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.868208] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.868208] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.868208] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.868208] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.868637] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.868637] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e50a13ae-126a-4814-bc46-eccfa7ba7182 is going to be updated. [ 703.915588] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.915588] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.915588] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.915588] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.915588] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.915840] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e50a13ae-126a-4814-bc46-eccfa7ba7182" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.968923] env[69188]: INFO networking_nsxv3.common.synchronization [None req-3004f8c0-dfad-4085-83eb-775c3da77e01 None None] Enqueued Resource ID: 18b7b8a0-3002-4c3f-80d5-4a9a152f862e with Priority: HIGHEST for action port [ 703.969265] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 18b7b8a0-3002-4c3f-80d5-4a9a152f862e with Priority: HIGHEST for action port [ 703.970661] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-18b7b8a0-3002-4c3f-80d5-4a9a152f862e taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.970826] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-18b7b8a0-3002-4c3f-80d5-4a9a152f862e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.970966] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-18b7b8a0-3002-4c3f-80d5-4a9a152f862e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.971213] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-18b7b8a0-3002-4c3f-80d5-4a9a152f862e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.971309] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('18b7b8a0-3002-4c3f-80d5-4a9a152f862e',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.227355] env[69188]: INFO networking_nsxv3.common.synchronization [None req-14510a7c-0285-478a-99af-ea6e60c81f86 None None] Enqueued Resource ID: 2a11cc0b-c939-4a89-9795-ffb3029f2ecf with Priority: HIGHEST for action port [ 704.227355] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2a11cc0b-c939-4a89-9795-ffb3029f2ecf with Priority: HIGHEST for action port [ 704.227765] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-2a11cc0b-c939-4a89-9795-ffb3029f2ecf taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.228009] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2a11cc0b-c939-4a89-9795-ffb3029f2ecf" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.228118] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2a11cc0b-c939-4a89-9795-ffb3029f2ecf" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.228962] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2a11cc0b-c939-4a89-9795-ffb3029f2ecf" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.228962] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2a11cc0b-c939-4a89-9795-ffb3029f2ecf',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.371459] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c019210a-f261-4200-a6cd-a6e2fc4f9396',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.475417] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 18b7b8a0-3002-4c3f-80d5-4a9a152f862e [ 704.475417] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.475417] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.475417] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.475557] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.475586] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.475683] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:18b7b8a0-3002-4c3f-80d5-4a9a152f862e already deleted. [ 704.475769] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-18b7b8a0-3002-4c3f-80d5-4a9a152f862e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.731391] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2a11cc0b-c939-4a89-9795-ffb3029f2ecf [ 704.733483] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.733871] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.734025] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.734388] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.734558] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.734817] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2a11cc0b-c939-4a89-9795-ffb3029f2ecf already deleted. [ 704.735435] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2a11cc0b-c939-4a89-9795-ffb3029f2ecf" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.875346] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e2f14ed1-21b8-4d1e-b6bc-559e167b9967 in Status: SUCCESS [ 704.875667] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e2f14ed1-21b8-4d1e-b6bc-559e167b9967" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.875947] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.876076] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.876142] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.876348] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.877953] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.877953] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c019210a-f261-4200-a6cd-a6e2fc4f9396 is going to be created. [ 704.900355] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.901037] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.901037] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.901037] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.901037] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.920932] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c019210a-f261-4200-a6cd-a6e2fc4f9396 in Status: UNINITIALIZED for 2s [ 705.035515] env[69188]: INFO networking_nsxv3.common.synchronization [req-b0842345-7ed6-488a-931f-7325f69d9678 req-014beb9f-f221-4dab-8743-429aef3a9bbb tempest-VolumesAdminNegativeTest-627287247 tempest-VolumesAdminNegativeTest-627287247-project-member] Enqueued Resource ID: cd207b0a-02a6-4378-9240-c9d49160b653 with Priority: HIGHEST for action security_group_members [ 705.039168] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cd207b0a-02a6-4378-9240-c9d49160b653 with Priority: HIGHEST for action security_group_members [ 705.039820] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-cd207b0a-02a6-4378-9240-c9d49160b653 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.039937] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cd207b0a-02a6-4378-9240-c9d49160b653" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.040700] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cd207b0a-02a6-4378-9240-c9d49160b653" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.040700] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cd207b0a-02a6-4378-9240-c9d49160b653" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.040700] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.040700] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.040700] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.040942] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.041508] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.042193] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cd207b0a-02a6-4378-9240-c9d49160b653',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.547260] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.547517] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.547517] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.547682] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.547770] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.547965] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.548087] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.548197] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.548338] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.548423] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.548501] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cd207b0a-02a6-4378-9240-c9d49160b653 already deleted. [ 705.548582] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cd207b0a-02a6-4378-9240-c9d49160b653" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.781815] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock network-836 taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.781938] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "network-836" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.782076] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "network-836" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.782438] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "network-836" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.782726] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.782895] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.783028] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.783316] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.783473] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.783716] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 705.783841] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] NeedRegenerationException {{(pid=69188) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 705.783954] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] no value, waiting for create lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 705.784689] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] value creation lock acquired {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 705.784689] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 705.784933] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Calling creation function for not-yet-present value {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 705.785123] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 705.803183] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 705.803389] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69188) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 705.803653] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Released creation lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 705.803843] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "network-836" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.804178] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock port-f5ab862a-2ebd-4a24-8128-4d1f059e9d76 taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.804623] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "port-f5ab862a-2ebd-4a24-8128-4d1f059e9d76" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.804623] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "port-f5ab862a-2ebd-4a24-8128-4d1f059e9d76" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.805521] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "port-f5ab862a-2ebd-4a24-8128-4d1f059e9d76" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.805782] env[69188]: DEBUG networking_nsxv3.api.rpc [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f5ab862a-2ebd-4a24-8128-4d1f059e9d76',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.308160] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.308480] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.308522] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.308825] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.308975] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.309200] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Segment Port f5ab862a-2ebd-4a24-8128-4d1f059e9d76 not found, creating... [ 706.309495] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.309665] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.309790] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.310033] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.310173] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.311419] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.311419] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.311419] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.311419] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.311419] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.311419] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Resource: SegmentPort with ID: f5ab862a-2ebd-4a24-8128-4d1f059e9d76 is going to be created. [ 706.330701] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.331040] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.331195] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.331561] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.331788] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.332036] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "port-f5ab862a-2ebd-4a24-8128-4d1f059e9d76" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.633241] env[69188]: INFO networking_nsxv3.common.synchronization [None req-221cdfca-6c32-4596-a770-68292e2b710d None None] Enqueued Resource ID: c7c9f8f0-861d-44cf-97a4-478b3c1b965f with Priority: HIGHEST for action port [ 706.633241] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c7c9f8f0-861d-44cf-97a4-478b3c1b965f with Priority: HIGHEST for action port [ 706.633241] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-c7c9f8f0-861d-44cf-97a4-478b3c1b965f taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.633241] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c7c9f8f0-861d-44cf-97a4-478b3c1b965f" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.633434] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c7c9f8f0-861d-44cf-97a4-478b3c1b965f" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.633572] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c7c9f8f0-861d-44cf-97a4-478b3c1b965f" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.633654] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c7c9f8f0-861d-44cf-97a4-478b3c1b965f',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.930724] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c019210a-f261-4200-a6cd-a6e2fc4f9396 in Status: SUCCESS [ 706.930724] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c019210a-f261-4200-a6cd-a6e2fc4f9396" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.930724] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c019210a-f261-4200-a6cd-a6e2fc4f9396" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.930724] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c019210a-f261-4200-a6cd-a6e2fc4f9396" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.930905] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.931042] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.931097] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.931256] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.931340] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.931425] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c019210a-f261-4200-a6cd-a6e2fc4f9396" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.931742] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c019210a-f261-4200-a6cd-a6e2fc4f9396',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.136733] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c7c9f8f0-861d-44cf-97a4-478b3c1b965f [ 707.136985] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.137141] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.137212] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.137426] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.137521] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.137616] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c7c9f8f0-861d-44cf-97a4-478b3c1b965f already deleted. [ 707.137720] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c7c9f8f0-861d-44cf-97a4-478b3c1b965f" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.434508] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-c019210a-f261-4200-a6cd-a6e2fc4f9396 taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.434807] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c019210a-f261-4200-a6cd-a6e2fc4f9396" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.434807] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c019210a-f261-4200-a6cd-a6e2fc4f9396" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.434959] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c019210a-f261-4200-a6cd-a6e2fc4f9396" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.435623] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.435623] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.435623] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.435623] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.435623] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.435623] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c019210a-f261-4200-a6cd-a6e2fc4f9396" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.435942] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-c019210a-f261-4200-a6cd-a6e2fc4f9396 taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.435942] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c019210a-f261-4200-a6cd-a6e2fc4f9396" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.435942] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c019210a-f261-4200-a6cd-a6e2fc4f9396" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.436078] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c019210a-f261-4200-a6cd-a6e2fc4f9396" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.436195] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.436291] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.436353] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.436495] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.436573] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.436677] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c019210a-f261-4200-a6cd-a6e2fc4f9396" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.436768] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c019210a-f261-4200-a6cd-a6e2fc4f9396',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.671199] env[69188]: INFO networking_nsxv3.common.synchronization [req-b0842345-7ed6-488a-931f-7325f69d9678 req-e7fb6d34-b2fa-48d9-864a-09be2ff6009c service nova] Enqueued Resource ID: cd207b0a-02a6-4378-9240-c9d49160b653 with Priority: HIGHEST for action security_group_rules [ 707.671199] env[69188]: INFO networking_nsxv3.common.synchronization [req-b0842345-7ed6-488a-931f-7325f69d9678 req-e7fb6d34-b2fa-48d9-864a-09be2ff6009c service nova] Enqueued Resource ID: cd207b0a-02a6-4378-9240-c9d49160b653 with Priority: HIGHEST for action security_group_members [ 707.671199] env[69188]: INFO networking_nsxv3.common.synchronization [req-b0842345-7ed6-488a-931f-7325f69d9678 req-e7fb6d34-b2fa-48d9-864a-09be2ff6009c service nova] Enqueued Resource ID: f5ab862a-2ebd-4a24-8128-4d1f059e9d76 with Priority: HIGHEST for action port [ 707.674512] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cd207b0a-02a6-4378-9240-c9d49160b653 with Priority: HIGHEST for action security_group_rules [ 707.674694] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cd207b0a-02a6-4378-9240-c9d49160b653 with Priority: HIGHEST for action security_group_members [ 707.674943] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f5ab862a-2ebd-4a24-8128-4d1f059e9d76 with Priority: HIGHEST for action port [ 707.675310] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cd207b0a-02a6-4378-9240-c9d49160b653 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.678095] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cd207b0a-02a6-4378-9240-c9d49160b653" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.678095] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cd207b0a-02a6-4378-9240-c9d49160b653" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.678095] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cd207b0a-02a6-4378-9240-c9d49160b653" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.678095] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cd207b0a-02a6-4378-9240-c9d49160b653',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.678095] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-cd207b0a-02a6-4378-9240-c9d49160b653 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.678095] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cd207b0a-02a6-4378-9240-c9d49160b653" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.678095] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cd207b0a-02a6-4378-9240-c9d49160b653" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.678095] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cd207b0a-02a6-4378-9240-c9d49160b653" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.678095] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.678095] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.681847] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.681847] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.681847] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.681847] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cd207b0a-02a6-4378-9240-c9d49160b653',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.681847] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-f5ab862a-2ebd-4a24-8128-4d1f059e9d76 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.681847] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f5ab862a-2ebd-4a24-8128-4d1f059e9d76" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.686200] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f5ab862a-2ebd-4a24-8128-4d1f059e9d76" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.686200] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f5ab862a-2ebd-4a24-8128-4d1f059e9d76" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.686200] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f5ab862a-2ebd-4a24-8128-4d1f059e9d76',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.946923] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c019210a-f261-4200-a6cd-a6e2fc4f9396: rpc.has_security_group_logging(os_id): False [ 707.968369] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.968524] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.968578] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.968826] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.968897] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.969182] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.969284] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.969348] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.969511] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.969587] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.969765] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.969857] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.969917] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.970083] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.970158] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.970337] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.970429] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.970490] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.970644] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.970735] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.970821] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c019210a-f261-4200-a6cd-a6e2fc4f9396 is going to be created. [ 708.023024] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.023248] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.023304] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.023495] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.023674] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.035165] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c019210a-f261-4200-a6cd-a6e2fc4f9396 in Status: IN_PROGRESS for 2s [ 708.186831] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cd207b0a-02a6-4378-9240-c9d49160b653',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.188596] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-cd207b0a-02a6-4378-9240-c9d49160b653 taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.188596] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cd207b0a-02a6-4378-9240-c9d49160b653" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.188596] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f5ab862a-2ebd-4a24-8128-4d1f059e9d76 with status ACTIVE [ 708.188596] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.189140] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.189140] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.189140] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.189140] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.189140] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.189294] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.189294] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.189440] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.189556] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.190109] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.190109] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.190109] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.190109] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.190109] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.190109] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f5ab862a-2ebd-4a24-8128-4d1f059e9d76 is going to be updated. [ 708.210112] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.210663] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.210765] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.210981] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.211137] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.211295] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f5ab862a-2ebd-4a24-8128-4d1f059e9d76" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.688821] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cd207b0a-02a6-4378-9240-c9d49160b653',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.193135] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.193135] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.193135] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.193135] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.193135] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.193135] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cd207b0a-02a6-4378-9240-c9d49160b653 is going to be created. [ 709.213355] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.213751] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.213896] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.214187] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.214430] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.226820] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cd207b0a-02a6-4378-9240-c9d49160b653 in Status: UNINITIALIZED for 2s [ 710.048591] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c019210a-f261-4200-a6cd-a6e2fc4f9396 in Status: SUCCESS [ 710.048855] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c019210a-f261-4200-a6cd-a6e2fc4f9396" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.238606] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cd207b0a-02a6-4378-9240-c9d49160b653 in Status: SUCCESS [ 711.238606] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cd207b0a-02a6-4378-9240-c9d49160b653" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.238606] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cd207b0a-02a6-4378-9240-c9d49160b653" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.238606] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cd207b0a-02a6-4378-9240-c9d49160b653" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.238606] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.238606] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.238606] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.238606] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.238606] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.238606] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cd207b0a-02a6-4378-9240-c9d49160b653" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.238606] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cd207b0a-02a6-4378-9240-c9d49160b653',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.740629] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cd207b0a-02a6-4378-9240-c9d49160b653',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.245632] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cd207b0a-02a6-4378-9240-c9d49160b653: rpc.has_security_group_logging(os_id): False [ 712.263716] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.263854] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.263911] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.264716] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.264716] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.264716] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.264716] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.264716] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.264922] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.264922] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.264970] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cd207b0a-02a6-4378-9240-c9d49160b653 is going to be created. [ 712.318938] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.319171] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.319248] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.319547] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.319732] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.335922] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cd207b0a-02a6-4378-9240-c9d49160b653 in Status: IN_PROGRESS for 2s [ 712.598824] env[69188]: INFO networking_nsxv3.common.synchronization [req-349e6a85-a49a-4e88-9363-d2b9b71837d8 req-234edbc7-016d-40c9-9d7b-3e64405914f1 tempest-DeleteServersAdminTestJSON-1786579670 tempest-DeleteServersAdminTestJSON-1786579670-project-member] Enqueued Resource ID: 8960cdd5-264d-45ae-a581-3531272dfbaa with Priority: HIGHEST for action security_group_members [ 712.598986] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8960cdd5-264d-45ae-a581-3531272dfbaa with Priority: HIGHEST for action security_group_members [ 712.599318] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-8960cdd5-264d-45ae-a581-3531272dfbaa taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.600028] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8960cdd5-264d-45ae-a581-3531272dfbaa" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.600028] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8960cdd5-264d-45ae-a581-3531272dfbaa" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.600028] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8960cdd5-264d-45ae-a581-3531272dfbaa" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.600028] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.600028] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.600028] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.600393] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.600528] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.600661] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8960cdd5-264d-45ae-a581-3531272dfbaa',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.086110] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock network-267 taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.086368] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "network-267" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.086566] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "network-267" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.087657] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "network-267" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.087657] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.088032] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.088032] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.088146] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.088383] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.088534] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 713.088655] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] NeedRegenerationException {{(pid=69188) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 713.088774] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] no value, waiting for create lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 713.088881] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] value creation lock acquired {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 713.088986] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 713.089178] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Calling creation function for not-yet-present value {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 713.089327] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 713.103327] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.103327] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.103327] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.103644] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.103690] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.103940] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.104062] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.104166] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.104368] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.104451] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.104545] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8960cdd5-264d-45ae-a581-3531272dfbaa is going to be updated. [ 713.108189] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 713.108413] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69188) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 713.108571] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Released creation lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 713.108743] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "network-267" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.109410] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock port-7fb7c08f-8f6a-4559-925e-f3de7a8866c2 taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.109410] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "port-7fb7c08f-8f6a-4559-925e-f3de7a8866c2" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.109554] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "port-7fb7c08f-8f6a-4559-925e-f3de7a8866c2" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.109799] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "port-7fb7c08f-8f6a-4559-925e-f3de7a8866c2" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.109936] env[69188]: DEBUG networking_nsxv3.api.rpc [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7fb7c08f-8f6a-4559-925e-f3de7a8866c2',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.131196] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.131457] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.131555] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.131887] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.132141] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.142122] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8960cdd5-264d-45ae-a581-3531272dfbaa in Status: IN_PROGRESS for 2s [ 713.613022] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.613499] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.613499] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.613824] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.614038] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.614279] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Segment Port 7fb7c08f-8f6a-4559-925e-f3de7a8866c2 not found, creating... [ 713.614655] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.614870] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.615074] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.615340] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.615525] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.616310] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.616537] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.616695] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.616992] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.617182] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.617366] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Resource: SegmentPort with ID: 7fb7c08f-8f6a-4559-925e-f3de7a8866c2 is going to be created. [ 713.636592] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.636592] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.636592] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.636882] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.637181] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.637450] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "port-7fb7c08f-8f6a-4559-925e-f3de7a8866c2" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.321285] env[69188]: INFO networking_nsxv3.common.synchronization [req-349e6a85-a49a-4e88-9363-d2b9b71837d8 req-94e1cbab-4f98-4a62-a466-ed3f2ce0caa5 service nova] Enqueued Resource ID: 8960cdd5-264d-45ae-a581-3531272dfbaa with Priority: HIGHEST for action security_group_rules [ 714.321285] env[69188]: INFO networking_nsxv3.common.synchronization [req-349e6a85-a49a-4e88-9363-d2b9b71837d8 req-94e1cbab-4f98-4a62-a466-ed3f2ce0caa5 service nova] Enqueued Resource ID: 8960cdd5-264d-45ae-a581-3531272dfbaa with Priority: HIGHEST for action security_group_members [ 714.321285] env[69188]: INFO networking_nsxv3.common.synchronization [req-349e6a85-a49a-4e88-9363-d2b9b71837d8 req-94e1cbab-4f98-4a62-a466-ed3f2ce0caa5 service nova] Enqueued Resource ID: 7fb7c08f-8f6a-4559-925e-f3de7a8866c2 with Priority: HIGHEST for action port [ 714.321285] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8960cdd5-264d-45ae-a581-3531272dfbaa with Priority: HIGHEST for action security_group_rules [ 714.321285] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8960cdd5-264d-45ae-a581-3531272dfbaa with Priority: HIGHEST for action security_group_members [ 714.321285] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7fb7c08f-8f6a-4559-925e-f3de7a8866c2 with Priority: HIGHEST for action port [ 714.321460] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8960cdd5-264d-45ae-a581-3531272dfbaa taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.321706] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8960cdd5-264d-45ae-a581-3531272dfbaa" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.321860] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8960cdd5-264d-45ae-a581-3531272dfbaa" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.322147] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8960cdd5-264d-45ae-a581-3531272dfbaa" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.322320] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8960cdd5-264d-45ae-a581-3531272dfbaa',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.323214] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-8960cdd5-264d-45ae-a581-3531272dfbaa taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.323432] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8960cdd5-264d-45ae-a581-3531272dfbaa" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.323696] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-7fb7c08f-8f6a-4559-925e-f3de7a8866c2 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.323909] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7fb7c08f-8f6a-4559-925e-f3de7a8866c2" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.324086] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7fb7c08f-8f6a-4559-925e-f3de7a8866c2" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.324397] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7fb7c08f-8f6a-4559-925e-f3de7a8866c2" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.324666] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7fb7c08f-8f6a-4559-925e-f3de7a8866c2',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.348127] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cd207b0a-02a6-4378-9240-c9d49160b653 in Status: SUCCESS [ 714.348127] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cd207b0a-02a6-4378-9240-c9d49160b653" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.826850] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-8960cdd5-264d-45ae-a581-3531272dfbaa taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.827249] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8960cdd5-264d-45ae-a581-3531272dfbaa" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.827249] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7fb7c08f-8f6a-4559-925e-f3de7a8866c2 with status ACTIVE [ 714.827374] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.827988] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.827988] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.827988] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.827988] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.828195] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.828195] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.828490] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.828490] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.828490] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.828665] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.828760] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.828821] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.828972] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.829049] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.829132] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7fb7c08f-8f6a-4559-925e-f3de7a8866c2 is going to be updated. [ 714.849915] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.850088] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.850153] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.850396] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.850533] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.850721] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7fb7c08f-8f6a-4559-925e-f3de7a8866c2" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.151782] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8960cdd5-264d-45ae-a581-3531272dfbaa in Status: SUCCESS [ 715.151978] env[69188]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8960cdd5-264d-45ae-a581-3531272dfbaa deletion is rescheduled due to dependency. [ 715.152129] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8960cdd5-264d-45ae-a581-3531272dfbaa" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.152270] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8960cdd5-264d-45ae-a581-3531272dfbaa" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.152492] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8960cdd5-264d-45ae-a581-3531272dfbaa" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.152681] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.152793] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.152863] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.153224] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.153224] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.153224] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8960cdd5-264d-45ae-a581-3531272dfbaa',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.327947] env[69188]: INFO networking_nsxv3.common.synchronization [req-90b602e7-687a-41fc-bb6c-b9f5d4309154 req-9a287dd3-b5de-4dcb-82b3-a6eee8e9ec03 tempest-FloatingIPsAssociationTestJSON-209902533 tempest-FloatingIPsAssociationTestJSON-209902533-project-member] Enqueued Resource ID: 53b2b927-2e3d-4111-b25a-7b34ab9fa28d with Priority: HIGHEST for action security_group_members [ 715.331743] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 53b2b927-2e3d-4111-b25a-7b34ab9fa28d with Priority: HIGHEST for action security_group_members [ 715.331743] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-53b2b927-2e3d-4111-b25a-7b34ab9fa28d taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.331743] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-53b2b927-2e3d-4111-b25a-7b34ab9fa28d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.331743] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-53b2b927-2e3d-4111-b25a-7b34ab9fa28d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.331743] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-53b2b927-2e3d-4111-b25a-7b34ab9fa28d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.331743] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.331743] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.331743] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.331743] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.331743] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.331743] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('53b2b927-2e3d-4111-b25a-7b34ab9fa28d',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.656263] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8960cdd5-264d-45ae-a581-3531272dfbaa',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.834308] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('53b2b927-2e3d-4111-b25a-7b34ab9fa28d',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.840889] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock network-66 taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.841113] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "network-66" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.841241] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "network-66" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.841516] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "network-66" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.841780] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.841960] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.842091] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.842307] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.842452] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.842660] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 715.842783] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] NeedRegenerationException {{(pid=69188) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 715.842903] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] no value, waiting for create lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 715.846019] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] value creation lock acquired {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 715.846019] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 715.846019] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Calling creation function for not-yet-present value {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 715.846019] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 715.862965] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 715.862965] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69188) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 715.862965] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Released creation lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 715.862965] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "network-66" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.862965] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock port-f72302df-6594-4a4a-ac4f-1cb25fef36ae taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.863208] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "port-f72302df-6594-4a4a-ac4f-1cb25fef36ae" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.863208] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "port-f72302df-6594-4a4a-ac4f-1cb25fef36ae" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.863544] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "port-f72302df-6594-4a4a-ac4f-1cb25fef36ae" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.863624] env[69188]: DEBUG networking_nsxv3.api.rpc [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f72302df-6594-4a4a-ac4f-1cb25fef36ae',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.159998] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8960cdd5-264d-45ae-a581-3531272dfbaa',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.345712] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('53b2b927-2e3d-4111-b25a-7b34ab9fa28d',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.368901] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.369185] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.369309] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.369593] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.370480] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.370480] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Segment Port f72302df-6594-4a4a-ac4f-1cb25fef36ae not found, creating... [ 716.370480] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.370480] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.370480] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.370680] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.371230] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.371230] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.371230] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.371724] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.371724] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.371724] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.374155] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Resource: SegmentPort with ID: f72302df-6594-4a4a-ac4f-1cb25fef36ae is going to be created. [ 716.390674] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.390885] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.391029] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.391330] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.391693] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.391787] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "port-f72302df-6594-4a4a-ac4f-1cb25fef36ae" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.662666] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.663134] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.663134] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.663221] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.663313] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.663348] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8960cdd5-264d-45ae-a581-3531272dfbaa is going to be updated. [ 716.689664] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.689834] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.689882] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.690201] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.690361] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.700190] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8960cdd5-264d-45ae-a581-3531272dfbaa in Status: IN_PROGRESS for 2s [ 716.848554] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.848954] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.848954] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.849109] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.849199] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.849387] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 53b2b927-2e3d-4111-b25a-7b34ab9fa28d is going to be updated. [ 716.878207] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.878431] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.878431] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.878629] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.878767] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.887446] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 53b2b927-2e3d-4111-b25a-7b34ab9fa28d in Status: IN_PROGRESS for 2s [ 717.283085] env[69188]: INFO networking_nsxv3.common.synchronization [req-90b602e7-687a-41fc-bb6c-b9f5d4309154 req-31f44d6c-f326-4e52-b422-5f0f199924f9 service nova] Enqueued Resource ID: 53b2b927-2e3d-4111-b25a-7b34ab9fa28d with Priority: HIGHEST for action security_group_rules [ 717.283721] env[69188]: INFO networking_nsxv3.common.synchronization [req-90b602e7-687a-41fc-bb6c-b9f5d4309154 req-31f44d6c-f326-4e52-b422-5f0f199924f9 service nova] Enqueued Resource ID: 53b2b927-2e3d-4111-b25a-7b34ab9fa28d with Priority: HIGHEST for action security_group_members [ 717.283721] env[69188]: INFO networking_nsxv3.common.synchronization [req-90b602e7-687a-41fc-bb6c-b9f5d4309154 req-31f44d6c-f326-4e52-b422-5f0f199924f9 service nova] Enqueued Resource ID: f72302df-6594-4a4a-ac4f-1cb25fef36ae with Priority: HIGHEST for action port [ 717.283721] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 53b2b927-2e3d-4111-b25a-7b34ab9fa28d with Priority: HIGHEST for action security_group_rules [ 717.283834] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 53b2b927-2e3d-4111-b25a-7b34ab9fa28d with Priority: HIGHEST for action security_group_members [ 717.283868] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f72302df-6594-4a4a-ac4f-1cb25fef36ae with Priority: HIGHEST for action port [ 717.284406] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-53b2b927-2e3d-4111-b25a-7b34ab9fa28d taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.284534] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-53b2b927-2e3d-4111-b25a-7b34ab9fa28d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.284608] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-53b2b927-2e3d-4111-b25a-7b34ab9fa28d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.284818] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-53b2b927-2e3d-4111-b25a-7b34ab9fa28d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.284898] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('53b2b927-2e3d-4111-b25a-7b34ab9fa28d',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.287341] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-53b2b927-2e3d-4111-b25a-7b34ab9fa28d taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.287841] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-53b2b927-2e3d-4111-b25a-7b34ab9fa28d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.289366] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-f72302df-6594-4a4a-ac4f-1cb25fef36ae taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.289366] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f72302df-6594-4a4a-ac4f-1cb25fef36ae" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.289366] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f72302df-6594-4a4a-ac4f-1cb25fef36ae" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.289366] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f72302df-6594-4a4a-ac4f-1cb25fef36ae" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.289366] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f72302df-6594-4a4a-ac4f-1cb25fef36ae',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.293601] env[69188]: INFO networking_nsxv3.common.synchronization [None req-4228f869-d54a-4e17-a775-059ca7dca4eb None None] Enqueued Resource ID: e0bcfae1-f278-456e-b00d-fc13372d3d81 with Priority: HIGHEST for action port [ 717.293873] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e0bcfae1-f278-456e-b00d-fc13372d3d81 with Priority: HIGHEST for action port [ 717.294446] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-e0bcfae1-f278-456e-b00d-fc13372d3d81 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.294563] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e0bcfae1-f278-456e-b00d-fc13372d3d81" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.294628] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e0bcfae1-f278-456e-b00d-fc13372d3d81" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.294896] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e0bcfae1-f278-456e-b00d-fc13372d3d81" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.295101] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e0bcfae1-f278-456e-b00d-fc13372d3d81',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.791509] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-53b2b927-2e3d-4111-b25a-7b34ab9fa28d taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.791671] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-53b2b927-2e3d-4111-b25a-7b34ab9fa28d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.793060] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f72302df-6594-4a4a-ac4f-1cb25fef36ae with status ACTIVE [ 717.793266] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.793395] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.793462] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.793684] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.793781] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.794386] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.794386] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.794386] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.794386] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.794386] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.794621] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.794621] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.794708] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.794857] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.794857] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.794939] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f72302df-6594-4a4a-ac4f-1cb25fef36ae is going to be updated. [ 717.801220] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e0bcfae1-f278-456e-b00d-fc13372d3d81 [ 717.801220] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.801220] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.801220] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.801220] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.801220] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.801220] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e0bcfae1-f278-456e-b00d-fc13372d3d81 already deleted. [ 717.801472] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e0bcfae1-f278-456e-b00d-fc13372d3d81" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.817992] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.818221] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.818221] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.818402] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.818547] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.818699] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f72302df-6594-4a4a-ac4f-1cb25fef36ae" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.616291] env[69188]: INFO networking_nsxv3.common.synchronization [None req-65ec42c4-6f04-401b-9faa-26ae266e4a11 tempest-ServersV294TestFqdnHostnames-1833622075 tempest-ServersV294TestFqdnHostnames-1833622075-project-member] Enqueued Resource ID: 2dad819d-4da9-4798-827e-298c399b35c5 with Priority: HIGHEST for action security_group_rules [ 718.616657] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2dad819d-4da9-4798-827e-298c399b35c5 with Priority: HIGHEST for action security_group_rules [ 718.617331] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2dad819d-4da9-4798-827e-298c399b35c5 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.617331] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2dad819d-4da9-4798-827e-298c399b35c5" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.617331] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2dad819d-4da9-4798-827e-298c399b35c5" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.617675] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2dad819d-4da9-4798-827e-298c399b35c5" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.617675] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2dad819d-4da9-4798-827e-298c399b35c5',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.709815] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8960cdd5-264d-45ae-a581-3531272dfbaa in Status: SUCCESS [ 718.711572] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8960cdd5-264d-45ae-a581-3531272dfbaa" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.711738] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8960cdd5-264d-45ae-a581-3531272dfbaa" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.712097] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8960cdd5-264d-45ae-a581-3531272dfbaa" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.712339] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.713109] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.713109] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.713109] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.713109] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.713109] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8960cdd5-264d-45ae-a581-3531272dfbaa" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.713109] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8960cdd5-264d-45ae-a581-3531272dfbaa',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.763059] env[69188]: INFO networking_nsxv3.common.synchronization [None req-d9f2b993-f7cc-47d5-9cf7-52b81c1d7b9d tempest-ServersV294TestFqdnHostnames-1833622075 tempest-ServersV294TestFqdnHostnames-1833622075-project-member] Enqueued Resource ID: 2dad819d-4da9-4798-827e-298c399b35c5 with Priority: HIGHEST for action security_group_rules [ 718.763059] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2dad819d-4da9-4798-827e-298c399b35c5 with Priority: HIGHEST for action security_group_rules [ 718.763172] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2dad819d-4da9-4798-827e-298c399b35c5 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.763243] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2dad819d-4da9-4798-827e-298c399b35c5" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.826442] env[69188]: INFO networking_nsxv3.common.synchronization [None req-2ef02837-5e8e-4654-ac0e-922ef8f55796 tempest-ImagesOneServerNegativeTestJSON-1186419322 tempest-ImagesOneServerNegativeTestJSON-1186419322-project-member] Enqueued Resource ID: 6c07e182-0219-4df3-be86-19b336b9003e with Priority: HIGHEST for action security_group_rules [ 718.826997] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6c07e182-0219-4df3-be86-19b336b9003e with Priority: HIGHEST for action security_group_rules [ 718.827315] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6c07e182-0219-4df3-be86-19b336b9003e taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.827440] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6c07e182-0219-4df3-be86-19b336b9003e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.827509] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6c07e182-0219-4df3-be86-19b336b9003e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.827775] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6c07e182-0219-4df3-be86-19b336b9003e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.827879] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6c07e182-0219-4df3-be86-19b336b9003e',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.900507] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 53b2b927-2e3d-4111-b25a-7b34ab9fa28d in Status: SUCCESS [ 718.900507] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-53b2b927-2e3d-4111-b25a-7b34ab9fa28d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.900507] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-53b2b927-2e3d-4111-b25a-7b34ab9fa28d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.900773] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-53b2b927-2e3d-4111-b25a-7b34ab9fa28d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.901374] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.901506] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.901576] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.901750] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.901838] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.901946] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('53b2b927-2e3d-4111-b25a-7b34ab9fa28d',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.154165] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.154365] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.154413] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.154677] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.154777] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.154886] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2dad819d-4da9-4798-827e-298c399b35c5 already deleted. [ 719.154994] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2dad819d-4da9-4798-827e-298c399b35c5" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.155196] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2dad819d-4da9-4798-827e-298c399b35c5" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.155359] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2dad819d-4da9-4798-827e-298c399b35c5" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.155471] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2dad819d-4da9-4798-827e-298c399b35c5',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.195818] env[69188]: INFO networking_nsxv3.common.synchronization [None req-1e4a7c55-6cef-4565-bfdd-9dc162120b11 tempest-ImagesOneServerNegativeTestJSON-1186419322 tempest-ImagesOneServerNegativeTestJSON-1186419322-project-member] Enqueued Resource ID: 6c07e182-0219-4df3-be86-19b336b9003e with Priority: HIGHEST for action security_group_rules [ 719.197912] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6c07e182-0219-4df3-be86-19b336b9003e with Priority: HIGHEST for action security_group_rules [ 719.198444] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6c07e182-0219-4df3-be86-19b336b9003e taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.198558] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6c07e182-0219-4df3-be86-19b336b9003e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.217438] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-8960cdd5-264d-45ae-a581-3531272dfbaa taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.217718] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8960cdd5-264d-45ae-a581-3531272dfbaa" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.217718] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8960cdd5-264d-45ae-a581-3531272dfbaa" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.217909] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8960cdd5-264d-45ae-a581-3531272dfbaa" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.218102] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.218304] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.218304] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.218443] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.218529] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.218619] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8960cdd5-264d-45ae-a581-3531272dfbaa" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.218912] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-8960cdd5-264d-45ae-a581-3531272dfbaa taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.218912] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8960cdd5-264d-45ae-a581-3531272dfbaa" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.218912] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8960cdd5-264d-45ae-a581-3531272dfbaa" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.219053] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8960cdd5-264d-45ae-a581-3531272dfbaa" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.219329] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.219329] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.219329] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.219521] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.219521] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.219605] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8960cdd5-264d-45ae-a581-3531272dfbaa" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.219647] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8960cdd5-264d-45ae-a581-3531272dfbaa',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.348414] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.348553] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.348624] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.348843] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.348929] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.349359] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6c07e182-0219-4df3-be86-19b336b9003e already deleted. [ 719.349359] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6c07e182-0219-4df3-be86-19b336b9003e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.349655] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6c07e182-0219-4df3-be86-19b336b9003e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.349940] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6c07e182-0219-4df3-be86-19b336b9003e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.349940] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6c07e182-0219-4df3-be86-19b336b9003e',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.404388] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('53b2b927-2e3d-4111-b25a-7b34ab9fa28d',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.591447] env[69188]: INFO networking_nsxv3.common.synchronization [req-cd92291b-ffb9-4b34-975f-15ad95796c17 req-166d8aba-ac27-43ae-8672-1a7d5ae2be79 tempest-AttachInterfacesV270Test-753387423 tempest-AttachInterfacesV270Test-753387423-project-member] Enqueued Resource ID: c019210a-f261-4200-a6cd-a6e2fc4f9396 with Priority: HIGHEST for action security_group_members [ 719.592352] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c019210a-f261-4200-a6cd-a6e2fc4f9396 with Priority: HIGHEST for action security_group_members [ 719.592534] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-c019210a-f261-4200-a6cd-a6e2fc4f9396 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.592660] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c019210a-f261-4200-a6cd-a6e2fc4f9396" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.592719] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c019210a-f261-4200-a6cd-a6e2fc4f9396" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.592953] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c019210a-f261-4200-a6cd-a6e2fc4f9396" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.593124] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.593231] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.593292] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.593443] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.593529] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.593622] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c019210a-f261-4200-a6cd-a6e2fc4f9396',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.678383] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.678383] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.678383] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.678383] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.678383] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.678383] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2dad819d-4da9-4798-827e-298c399b35c5 already deleted. [ 719.678383] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2dad819d-4da9-4798-827e-298c399b35c5" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.721822] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8960cdd5-264d-45ae-a581-3531272dfbaa: rpc.has_security_group_logging(os_id): False [ 719.742384] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.742822] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.745018] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.745018] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.745018] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.745018] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.745018] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.745018] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.745018] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.745018] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.745018] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.745018] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.745018] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.745018] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.745018] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.745018] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.745507] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.745507] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.745956] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.746051] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.746272] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8960cdd5-264d-45ae-a581-3531272dfbaa is going to be updated. [ 719.808989] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.809174] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.809324] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.809765] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.810276] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.822038] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8960cdd5-264d-45ae-a581-3531272dfbaa in Status: IN_PROGRESS for 2s [ 719.875719] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.875883] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.875957] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.876208] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.876305] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.876405] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6c07e182-0219-4df3-be86-19b336b9003e already deleted. [ 719.876486] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6c07e182-0219-4df3-be86-19b336b9003e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.898580] env[69188]: INFO networking_nsxv3.common.synchronization [None req-8cac7987-a3a7-4022-a82d-ea8ad94f4562 None None] Enqueued Resource ID: f2ccc769-515e-4460-ac43-af62b4ec0cb8 with Priority: HIGHEST for action port [ 719.899306] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f2ccc769-515e-4460-ac43-af62b4ec0cb8 with Priority: HIGHEST for action port [ 719.899614] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-f2ccc769-515e-4460-ac43-af62b4ec0cb8 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.900182] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f2ccc769-515e-4460-ac43-af62b4ec0cb8" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.900252] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f2ccc769-515e-4460-ac43-af62b4ec0cb8" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.900475] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f2ccc769-515e-4460-ac43-af62b4ec0cb8" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.900562] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f2ccc769-515e-4460-ac43-af62b4ec0cb8',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.906989] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('53b2b927-2e3d-4111-b25a-7b34ab9fa28d',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.096896] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.096896] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.096896] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.099111] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.099111] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.099111] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.099111] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.099111] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.099111] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.099111] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.099111] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c019210a-f261-4200-a6cd-a6e2fc4f9396 is going to be updated. [ 720.121467] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.121616] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.121683] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.121907] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.122068] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.130861] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c019210a-f261-4200-a6cd-a6e2fc4f9396 in Status: IN_PROGRESS for 2s [ 720.402580] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f2ccc769-515e-4460-ac43-af62b4ec0cb8 [ 720.402906] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.403034] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.403108] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.403800] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.403919] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.404044] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f2ccc769-515e-4460-ac43-af62b4ec0cb8 already deleted. [ 720.404141] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f2ccc769-515e-4460-ac43-af62b4ec0cb8" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.413888] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.414096] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.414177] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.414584] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.414694] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.414833] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 53b2b927-2e3d-4111-b25a-7b34ab9fa28d is going to be updated. [ 720.445079] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.445239] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.446288] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.446288] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.446288] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.454485] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 53b2b927-2e3d-4111-b25a-7b34ab9fa28d in Status: IN_PROGRESS for 2s [ 721.835253] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8960cdd5-264d-45ae-a581-3531272dfbaa in Status: SUCCESS [ 721.835498] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8960cdd5-264d-45ae-a581-3531272dfbaa" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.146370] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c019210a-f261-4200-a6cd-a6e2fc4f9396 in Status: SUCCESS [ 722.146370] env[69188]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c019210a-f261-4200-a6cd-a6e2fc4f9396 deletion is rescheduled due to dependency. [ 722.146449] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c019210a-f261-4200-a6cd-a6e2fc4f9396" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.464727] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 53b2b927-2e3d-4111-b25a-7b34ab9fa28d in Status: SUCCESS [ 722.464868] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-53b2b927-2e3d-4111-b25a-7b34ab9fa28d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.465067] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-53b2b927-2e3d-4111-b25a-7b34ab9fa28d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.465292] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-53b2b927-2e3d-4111-b25a-7b34ab9fa28d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.465478] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.465591] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.465655] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.465809] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.465890] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.465974] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-53b2b927-2e3d-4111-b25a-7b34ab9fa28d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.466075] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('53b2b927-2e3d-4111-b25a-7b34ab9fa28d',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.969562] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-53b2b927-2e3d-4111-b25a-7b34ab9fa28d taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.970062] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-53b2b927-2e3d-4111-b25a-7b34ab9fa28d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.970062] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-53b2b927-2e3d-4111-b25a-7b34ab9fa28d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.970062] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-53b2b927-2e3d-4111-b25a-7b34ab9fa28d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.970226] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.970288] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.970326] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.970462] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.970700] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.970700] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-53b2b927-2e3d-4111-b25a-7b34ab9fa28d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.970790] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-53b2b927-2e3d-4111-b25a-7b34ab9fa28d taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.970844] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-53b2b927-2e3d-4111-b25a-7b34ab9fa28d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.970891] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-53b2b927-2e3d-4111-b25a-7b34ab9fa28d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.971042] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-53b2b927-2e3d-4111-b25a-7b34ab9fa28d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.971186] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.971277] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.971337] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.971474] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.971549] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.971632] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-53b2b927-2e3d-4111-b25a-7b34ab9fa28d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.971719] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('53b2b927-2e3d-4111-b25a-7b34ab9fa28d',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.343896] env[69188]: INFO networking_nsxv3.common.synchronization [None req-85b79b38-8c66-40f1-9fd2-79b311f25257 None None] Enqueued Resource ID: 5222b73f-4363-4f9f-9642-d1487347d62a with Priority: HIGHEST for action port [ 723.344628] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5222b73f-4363-4f9f-9642-d1487347d62a with Priority: HIGHEST for action port [ 723.346057] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-5222b73f-4363-4f9f-9642-d1487347d62a taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.346231] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5222b73f-4363-4f9f-9642-d1487347d62a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.346352] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5222b73f-4363-4f9f-9642-d1487347d62a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.346616] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5222b73f-4363-4f9f-9642-d1487347d62a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.346735] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5222b73f-4363-4f9f-9642-d1487347d62a',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.477671] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 53b2b927-2e3d-4111-b25a-7b34ab9fa28d: rpc.has_security_group_logging(os_id): False [ 723.494082] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.494301] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.494415] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.494677] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.494832] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.495104] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.495223] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.495308] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.495550] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.495659] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.495957] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.497151] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.497151] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.497373] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.497482] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.497707] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.497801] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.497869] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.498172] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.498172] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.498294] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 53b2b927-2e3d-4111-b25a-7b34ab9fa28d is going to be updated. [ 723.555167] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.555167] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.555167] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.555167] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.555167] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.591841] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 53b2b927-2e3d-4111-b25a-7b34ab9fa28d in Status: IN_PROGRESS for 2s [ 723.727571] env[69188]: INFO networking_nsxv3.common.synchronization [req-80769f1a-8d07-4730-a0b1-71a5ab37602b req-45979542-0452-487d-beb2-f100633f5fd9 tempest-ServersAdminTestJSON-1988649207 tempest-ServersAdminTestJSON-1988649207-project-member] Enqueued Resource ID: 5e76d42e-7ec6-4a5e-aa9c-c5a285d62318 with Priority: HIGHEST for action security_group_members [ 723.728274] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e76d42e-7ec6-4a5e-aa9c-c5a285d62318 with Priority: HIGHEST for action security_group_members [ 723.728587] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e76d42e-7ec6-4a5e-aa9c-c5a285d62318 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.728711] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e76d42e-7ec6-4a5e-aa9c-c5a285d62318" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.728777] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e76d42e-7ec6-4a5e-aa9c-c5a285d62318" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.729064] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e76d42e-7ec6-4a5e-aa9c-c5a285d62318" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.729225] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.729325] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.729383] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.729530] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.729611] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.729703] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5e76d42e-7ec6-4a5e-aa9c-c5a285d62318',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.849848] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5222b73f-4363-4f9f-9642-d1487347d62a [ 723.850155] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.850375] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.850448] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.850640] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.850742] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.850869] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5222b73f-4363-4f9f-9642-d1487347d62a already deleted. [ 723.850959] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5222b73f-4363-4f9f-9642-d1487347d62a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.233618] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.233960] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.233960] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.234187] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.234255] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.234431] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.234530] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.236263] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.236263] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.236263] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.236263] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5e76d42e-7ec6-4a5e-aa9c-c5a285d62318 already deleted. [ 724.236263] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e76d42e-7ec6-4a5e-aa9c-c5a285d62318" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.400982] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock network-932 taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.401411] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "network-932" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.402015] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "network-932" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.402015] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "network-932" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.402436] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.402729] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.402944] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.405900] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.405900] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.405900] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 724.405900] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] NeedRegenerationException {{(pid=69188) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 724.405900] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] no value, waiting for create lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 724.405900] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] value creation lock acquired {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 724.405900] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 724.405900] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Calling creation function for not-yet-present value {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 724.405900] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 724.424300] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 724.424300] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69188) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 724.424300] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Released creation lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 724.424300] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "network-932" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.424300] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock port-3172261d-0c10-46fc-a737-07946e2d184f taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.424300] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "port-3172261d-0c10-46fc-a737-07946e2d184f" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.424300] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "port-3172261d-0c10-46fc-a737-07946e2d184f" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.424300] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "port-3172261d-0c10-46fc-a737-07946e2d184f" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.424300] env[69188]: DEBUG networking_nsxv3.api.rpc [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3172261d-0c10-46fc-a737-07946e2d184f',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.762406] env[69188]: INFO networking_nsxv3.common.synchronization [req-eb89b8ca-83f9-4834-a56a-2c0c06dd92df req-4538c57c-a5fe-405d-bea5-a55139e6f703 tempest-DeleteServersAdminTestJSON-1786579670 tempest-DeleteServersAdminTestJSON-1786579670-project-member] Enqueued Resource ID: 8960cdd5-264d-45ae-a581-3531272dfbaa with Priority: HIGHEST for action security_group_members [ 724.762983] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8960cdd5-264d-45ae-a581-3531272dfbaa with Priority: HIGHEST for action security_group_members [ 724.763236] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-8960cdd5-264d-45ae-a581-3531272dfbaa taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.763358] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8960cdd5-264d-45ae-a581-3531272dfbaa" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.763442] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8960cdd5-264d-45ae-a581-3531272dfbaa" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.763692] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8960cdd5-264d-45ae-a581-3531272dfbaa" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.764932] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.764932] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.764932] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.764932] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.764932] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.764932] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8960cdd5-264d-45ae-a581-3531272dfbaa',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.930406] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.930406] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.930406] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.930406] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.930406] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.930406] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Segment Port 3172261d-0c10-46fc-a737-07946e2d184f not found, creating... [ 724.930406] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.930406] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.930406] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.932986] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.932986] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.932986] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.932986] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.932986] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.932986] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.932986] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.932986] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Resource: SegmentPort with ID: 3172261d-0c10-46fc-a737-07946e2d184f is going to be created. [ 724.953228] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.953228] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.953228] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.953228] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.953228] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.953536] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "port-3172261d-0c10-46fc-a737-07946e2d184f" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.141921] env[69188]: INFO networking_nsxv3.common.synchronization [None req-0295d1c8-597b-481a-a473-e6f20ee849b6 None None] Enqueued Resource ID: 555f3672-7e94-4cbf-9e10-36e04f2dab53 with Priority: HIGHEST for action port [ 725.143116] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 555f3672-7e94-4cbf-9e10-36e04f2dab53 with Priority: HIGHEST for action port [ 725.143558] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-555f3672-7e94-4cbf-9e10-36e04f2dab53 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.143746] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-555f3672-7e94-4cbf-9e10-36e04f2dab53" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.143879] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-555f3672-7e94-4cbf-9e10-36e04f2dab53" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.144282] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-555f3672-7e94-4cbf-9e10-36e04f2dab53" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.144416] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('555f3672-7e94-4cbf-9e10-36e04f2dab53',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.267010] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.267315] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.267315] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.267463] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.267556] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.267750] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.267862] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.267942] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.268116] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.268197] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.268288] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8960cdd5-264d-45ae-a581-3531272dfbaa is going to be updated. [ 725.296381] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.296529] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.296587] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.296792] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.297008] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.306087] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8960cdd5-264d-45ae-a581-3531272dfbaa in Status: IN_PROGRESS for 2s [ 725.604602] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 53b2b927-2e3d-4111-b25a-7b34ab9fa28d in Status: SUCCESS [ 725.604602] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-53b2b927-2e3d-4111-b25a-7b34ab9fa28d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.647146] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 555f3672-7e94-4cbf-9e10-36e04f2dab53 [ 725.647146] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.647146] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.647279] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.648114] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.648114] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.648114] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:555f3672-7e94-4cbf-9e10-36e04f2dab53 already deleted. [ 725.648114] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-555f3672-7e94-4cbf-9e10-36e04f2dab53" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.805185] env[69188]: INFO networking_nsxv3.common.synchronization [req-80769f1a-8d07-4730-a0b1-71a5ab37602b req-43c60d5c-46d9-4cc8-b5b6-306c0855bbf0 service nova] Enqueued Resource ID: 5e76d42e-7ec6-4a5e-aa9c-c5a285d62318 with Priority: HIGHEST for action security_group_rules [ 725.805367] env[69188]: INFO networking_nsxv3.common.synchronization [req-80769f1a-8d07-4730-a0b1-71a5ab37602b req-43c60d5c-46d9-4cc8-b5b6-306c0855bbf0 service nova] Enqueued Resource ID: 5e76d42e-7ec6-4a5e-aa9c-c5a285d62318 with Priority: HIGHEST for action security_group_members [ 725.805507] env[69188]: INFO networking_nsxv3.common.synchronization [req-80769f1a-8d07-4730-a0b1-71a5ab37602b req-43c60d5c-46d9-4cc8-b5b6-306c0855bbf0 service nova] Enqueued Resource ID: 3172261d-0c10-46fc-a737-07946e2d184f with Priority: HIGHEST for action port [ 725.805735] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e76d42e-7ec6-4a5e-aa9c-c5a285d62318 with Priority: HIGHEST for action security_group_rules [ 725.805862] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e76d42e-7ec6-4a5e-aa9c-c5a285d62318 with Priority: HIGHEST for action security_group_members [ 725.805961] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3172261d-0c10-46fc-a737-07946e2d184f with Priority: HIGHEST for action port [ 725.806511] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5e76d42e-7ec6-4a5e-aa9c-c5a285d62318 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.806617] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5e76d42e-7ec6-4a5e-aa9c-c5a285d62318" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.806685] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5e76d42e-7ec6-4a5e-aa9c-c5a285d62318" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.806951] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5e76d42e-7ec6-4a5e-aa9c-c5a285d62318" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.807789] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5e76d42e-7ec6-4a5e-aa9c-c5a285d62318',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.808729] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e76d42e-7ec6-4a5e-aa9c-c5a285d62318 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.808953] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e76d42e-7ec6-4a5e-aa9c-c5a285d62318" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.809036] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e76d42e-7ec6-4a5e-aa9c-c5a285d62318" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.809247] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e76d42e-7ec6-4a5e-aa9c-c5a285d62318" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.809355] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.809452] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.809516] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.809657] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.809741] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.809832] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5e76d42e-7ec6-4a5e-aa9c-c5a285d62318',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.810759] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-3172261d-0c10-46fc-a737-07946e2d184f taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.810873] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3172261d-0c10-46fc-a737-07946e2d184f" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.810942] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3172261d-0c10-46fc-a737-07946e2d184f" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.811227] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3172261d-0c10-46fc-a737-07946e2d184f" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.811304] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3172261d-0c10-46fc-a737-07946e2d184f',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.312694] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e76d42e-7ec6-4a5e-aa9c-c5a285d62318 taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.312990] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e76d42e-7ec6-4a5e-aa9c-c5a285d62318" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.313094] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5e76d42e-7ec6-4a5e-aa9c-c5a285d62318',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.315618] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3172261d-0c10-46fc-a737-07946e2d184f with status ACTIVE [ 726.315823] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.315948] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.322993] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.322993] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.322993] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.322993] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.322993] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.322993] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.322993] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.322993] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.322993] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.322993] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.322993] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.322993] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.322993] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.322993] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3172261d-0c10-46fc-a737-07946e2d184f is going to be updated. [ 726.341277] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.341277] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.341277] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.341277] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.341277] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.341277] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3172261d-0c10-46fc-a737-07946e2d184f" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.815769] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5e76d42e-7ec6-4a5e-aa9c-c5a285d62318',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.315045] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8960cdd5-264d-45ae-a581-3531272dfbaa in Status: SUCCESS [ 727.315317] env[69188]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8960cdd5-264d-45ae-a581-3531272dfbaa deletion is rescheduled due to dependency. [ 727.315352] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8960cdd5-264d-45ae-a581-3531272dfbaa" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.318844] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.318964] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.319050] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.319286] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.319363] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.319460] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5e76d42e-7ec6-4a5e-aa9c-c5a285d62318 is going to be created. [ 727.341427] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.341646] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.341738] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.341883] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.342044] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.350561] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5e76d42e-7ec6-4a5e-aa9c-c5a285d62318 in Status: UNINITIALIZED for 2s [ 728.767049] env[69188]: INFO networking_nsxv3.common.synchronization [req-43528021-2eb8-4556-9ff5-e3a69cef1097 req-c11dbbde-13cd-49bd-a9ea-af776622fe8d tempest-ServerDiskConfigTestJSON-1476779099 tempest-ServerDiskConfigTestJSON-1476779099-project-member] Enqueued Resource ID: 24a7b083-b432-46d6-94de-76adf6ce22b3 with Priority: HIGHEST for action security_group_members [ 728.767631] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 24a7b083-b432-46d6-94de-76adf6ce22b3 with Priority: HIGHEST for action security_group_members [ 728.768863] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-24a7b083-b432-46d6-94de-76adf6ce22b3 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.768863] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-24a7b083-b432-46d6-94de-76adf6ce22b3" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.768863] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-24a7b083-b432-46d6-94de-76adf6ce22b3" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.768863] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-24a7b083-b432-46d6-94de-76adf6ce22b3" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.768863] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.768863] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.769333] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.769333] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.769333] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.769333] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('24a7b083-b432-46d6-94de-76adf6ce22b3',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.238044] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock network-907 taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.238044] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "network-907" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.238044] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "network-907" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.238349] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "network-907" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.238560] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.240525] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.240525] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.240525] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.240525] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.240525] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 729.240525] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] NeedRegenerationException {{(pid=69188) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 729.240525] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] no value, waiting for create lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 729.240525] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] value creation lock acquired {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 729.240525] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 729.240525] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Calling creation function for not-yet-present value {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 729.240525] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 729.266596] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 729.266762] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=69188) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 729.266952] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Released creation lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 729.267169] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "network-907" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.267477] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock port-4f51031c-714f-412b-b364-6d4a1bafe96a taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.267647] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "port-4f51031c-714f-412b-b364-6d4a1bafe96a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.267768] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "port-4f51031c-714f-412b-b364-6d4a1bafe96a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.268125] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "port-4f51031c-714f-412b-b364-6d4a1bafe96a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.268271] env[69188]: DEBUG networking_nsxv3.api.rpc [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4f51031c-714f-412b-b364-6d4a1bafe96a',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.272023] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.272148] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.272217] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.272616] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.272616] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.272712] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.273330] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.273428] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.273588] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.273662] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.273750] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 24a7b083-b432-46d6-94de-76adf6ce22b3 already deleted. [ 729.273833] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-24a7b083-b432-46d6-94de-76adf6ce22b3" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.362129] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5e76d42e-7ec6-4a5e-aa9c-c5a285d62318 in Status: SUCCESS [ 729.362313] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e76d42e-7ec6-4a5e-aa9c-c5a285d62318" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.362475] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e76d42e-7ec6-4a5e-aa9c-c5a285d62318" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.362699] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e76d42e-7ec6-4a5e-aa9c-c5a285d62318" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.362891] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.363167] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.363167] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.363257] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.363322] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.363398] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e76d42e-7ec6-4a5e-aa9c-c5a285d62318" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.363553] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5e76d42e-7ec6-4a5e-aa9c-c5a285d62318',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.770377] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.770695] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.770763] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.771198] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.771399] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.771606] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Segment Port 4f51031c-714f-412b-b364-6d4a1bafe96a not found, creating... [ 729.771907] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.772132] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.772308] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.772485] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.772622] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.772935] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.773100] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.773284] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.773513] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.773652] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.773806] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Resource: SegmentPort with ID: 4f51031c-714f-412b-b364-6d4a1bafe96a is going to be created. [ 729.797636] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.797636] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.797636] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.797636] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.797636] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.797636] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "port-4f51031c-714f-412b-b364-6d4a1bafe96a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.869917] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e76d42e-7ec6-4a5e-aa9c-c5a285d62318 taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.869917] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e76d42e-7ec6-4a5e-aa9c-c5a285d62318" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.869917] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e76d42e-7ec6-4a5e-aa9c-c5a285d62318" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.869917] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e76d42e-7ec6-4a5e-aa9c-c5a285d62318" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.869917] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.869917] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.869917] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.869917] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.869917] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.869917] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e76d42e-7ec6-4a5e-aa9c-c5a285d62318" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.869917] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e76d42e-7ec6-4a5e-aa9c-c5a285d62318 taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.869917] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e76d42e-7ec6-4a5e-aa9c-c5a285d62318" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.869917] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e76d42e-7ec6-4a5e-aa9c-c5a285d62318" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.869917] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e76d42e-7ec6-4a5e-aa9c-c5a285d62318" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.869917] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.869917] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.870575] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.870575] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.870575] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.870575] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e76d42e-7ec6-4a5e-aa9c-c5a285d62318" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.870575] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5e76d42e-7ec6-4a5e-aa9c-c5a285d62318',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.375021] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5e76d42e-7ec6-4a5e-aa9c-c5a285d62318: rpc.has_security_group_logging(os_id): False [ 730.392619] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.392763] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.392838] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.393099] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.393214] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.393406] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.393506] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.393571] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.393725] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.393802] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.394356] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.394494] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.394565] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.394769] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.394909] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.395143] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.395255] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.395324] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.395498] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.395652] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.395796] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5e76d42e-7ec6-4a5e-aa9c-c5a285d62318 is going to be created. [ 730.451513] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.451680] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.451725] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.452052] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.452350] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.463845] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5e76d42e-7ec6-4a5e-aa9c-c5a285d62318 in Status: IN_PROGRESS for 2s [ 730.763159] env[69188]: INFO networking_nsxv3.common.synchronization [req-43528021-2eb8-4556-9ff5-e3a69cef1097 req-877f07c3-db2a-46c3-88f0-c4ec35cb0798 service nova] Enqueued Resource ID: 24a7b083-b432-46d6-94de-76adf6ce22b3 with Priority: HIGHEST for action security_group_rules [ 730.763159] env[69188]: INFO networking_nsxv3.common.synchronization [req-43528021-2eb8-4556-9ff5-e3a69cef1097 req-877f07c3-db2a-46c3-88f0-c4ec35cb0798 service nova] Enqueued Resource ID: 24a7b083-b432-46d6-94de-76adf6ce22b3 with Priority: HIGHEST for action security_group_members [ 730.763159] env[69188]: INFO networking_nsxv3.common.synchronization [req-43528021-2eb8-4556-9ff5-e3a69cef1097 req-877f07c3-db2a-46c3-88f0-c4ec35cb0798 service nova] Enqueued Resource ID: 4f51031c-714f-412b-b364-6d4a1bafe96a with Priority: HIGHEST for action port [ 730.763159] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 24a7b083-b432-46d6-94de-76adf6ce22b3 with Priority: HIGHEST for action security_group_rules [ 730.763159] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 24a7b083-b432-46d6-94de-76adf6ce22b3 with Priority: HIGHEST for action security_group_members [ 730.763159] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4f51031c-714f-412b-b364-6d4a1bafe96a with Priority: HIGHEST for action port [ 730.767455] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-24a7b083-b432-46d6-94de-76adf6ce22b3 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.767595] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-24a7b083-b432-46d6-94de-76adf6ce22b3" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.767649] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-24a7b083-b432-46d6-94de-76adf6ce22b3" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.769106] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-24a7b083-b432-46d6-94de-76adf6ce22b3" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.769106] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('24a7b083-b432-46d6-94de-76adf6ce22b3',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.769106] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-24a7b083-b432-46d6-94de-76adf6ce22b3 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.769106] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-24a7b083-b432-46d6-94de-76adf6ce22b3" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.769106] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-24a7b083-b432-46d6-94de-76adf6ce22b3" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.769562] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-24a7b083-b432-46d6-94de-76adf6ce22b3" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.769562] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.769562] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.769562] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.769745] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.769794] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.769835] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('24a7b083-b432-46d6-94de-76adf6ce22b3',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.770628] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-4f51031c-714f-412b-b364-6d4a1bafe96a taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.770898] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4f51031c-714f-412b-b364-6d4a1bafe96a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.770898] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4f51031c-714f-412b-b364-6d4a1bafe96a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.770898] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4f51031c-714f-412b-b364-6d4a1bafe96a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.771049] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4f51031c-714f-412b-b364-6d4a1bafe96a',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.245311] env[69188]: INFO networking_nsxv3.common.synchronization [req-d52f0304-3719-4a81-b0a4-2eafad7c8de9 req-fc830e70-246d-445b-869d-1a709440de99 tempest-ServersAdminTestJSON-1988649207 tempest-ServersAdminTestJSON-1988649207-project-member] Enqueued Resource ID: 5e76d42e-7ec6-4a5e-aa9c-c5a285d62318 with Priority: HIGHEST for action security_group_members [ 731.246766] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e76d42e-7ec6-4a5e-aa9c-c5a285d62318 with Priority: HIGHEST for action security_group_members [ 731.246766] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e76d42e-7ec6-4a5e-aa9c-c5a285d62318 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.246766] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e76d42e-7ec6-4a5e-aa9c-c5a285d62318" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.246766] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e76d42e-7ec6-4a5e-aa9c-c5a285d62318" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.246766] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e76d42e-7ec6-4a5e-aa9c-c5a285d62318" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.246766] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.246766] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.246766] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.247174] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.247174] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.248901] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5e76d42e-7ec6-4a5e-aa9c-c5a285d62318',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.273257] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-24a7b083-b432-46d6-94de-76adf6ce22b3 taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.273257] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-24a7b083-b432-46d6-94de-76adf6ce22b3" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.281021] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('24a7b083-b432-46d6-94de-76adf6ce22b3',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.281021] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4f51031c-714f-412b-b364-6d4a1bafe96a with status ACTIVE [ 731.281021] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.281021] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.281021] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.281021] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.281021] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.281021] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.281021] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.281021] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.281021] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.281021] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.281021] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.281021] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.281021] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.281021] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.281523] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.281523] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4f51031c-714f-412b-b364-6d4a1bafe96a is going to be updated. [ 731.303648] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.303648] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.303648] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.303648] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.303648] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.303648] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4f51031c-714f-412b-b364-6d4a1bafe96a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.687734] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock network-932 taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.687957] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "network-932" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.688114] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "network-932" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.688391] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "network-932" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.688651] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.688808] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.688925] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.691132] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.691357] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.691587] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 731.691708] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] NeedRegenerationException {{(pid=69188) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 731.691814] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] no value, waiting for create lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 731.691924] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] value creation lock acquired {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 731.692038] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 731.692144] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Calling creation function for not-yet-present value {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 731.692276] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 731.712430] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 731.712586] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69188) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 731.712728] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Released creation lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 731.712945] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "network-932" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.713317] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock port-8551820f-a746-4b28-b9c8-fa47765128d1 taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.713502] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "port-8551820f-a746-4b28-b9c8-fa47765128d1" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.713622] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "port-8551820f-a746-4b28-b9c8-fa47765128d1" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.713960] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "port-8551820f-a746-4b28-b9c8-fa47765128d1" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.714109] env[69188]: DEBUG networking_nsxv3.api.rpc [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8551820f-a746-4b28-b9c8-fa47765128d1',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.752622] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5e76d42e-7ec6-4a5e-aa9c-c5a285d62318',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.784031] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('24a7b083-b432-46d6-94de-76adf6ce22b3',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.198960] env[69188]: INFO networking_nsxv3.common.synchronization [req-7627d039-69e6-49eb-9f40-b47919e3ecce req-07552cd8-7a6b-49e2-934e-5cd4496f4202 tempest-ListServerFiltersTestJSON-1426102960 tempest-ListServerFiltersTestJSON-1426102960-project-member] Enqueued Resource ID: e2f14ed1-21b8-4d1e-b6bc-559e167b9967 with Priority: HIGHEST for action security_group_members [ 732.202505] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2f14ed1-21b8-4d1e-b6bc-559e167b9967 with Priority: HIGHEST for action security_group_members [ 732.202968] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2f14ed1-21b8-4d1e-b6bc-559e167b9967 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.203238] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2f14ed1-21b8-4d1e-b6bc-559e167b9967" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.203389] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2f14ed1-21b8-4d1e-b6bc-559e167b9967" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.203662] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2f14ed1-21b8-4d1e-b6bc-559e167b9967" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.203897] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.204104] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.205771] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.205771] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.205771] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.205771] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e2f14ed1-21b8-4d1e-b6bc-559e167b9967',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.218095] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.218095] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.218242] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.219258] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.219258] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.219258] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Segment Port 8551820f-a746-4b28-b9c8-fa47765128d1 not found, creating... [ 732.219258] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.219258] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.219258] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.219500] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.219573] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.219857] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.220018] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.220141] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.220366] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.220481] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.220619] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Resource: SegmentPort with ID: 8551820f-a746-4b28-b9c8-fa47765128d1 is going to be created. [ 732.238509] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.238805] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.238871] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.239160] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.239401] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.239660] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "port-8551820f-a746-4b28-b9c8-fa47765128d1" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.260088] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5e76d42e-7ec6-4a5e-aa9c-c5a285d62318',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.286802] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.287045] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.287130] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.287315] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.287709] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.287802] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 24a7b083-b432-46d6-94de-76adf6ce22b3 is going to be created. [ 732.325650] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.325789] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.325875] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.326122] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.326295] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.344582] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 24a7b083-b432-46d6-94de-76adf6ce22b3 in Status: UNINITIALIZED for 2s [ 732.474734] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5e76d42e-7ec6-4a5e-aa9c-c5a285d62318 in Status: SUCCESS [ 732.474995] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5e76d42e-7ec6-4a5e-aa9c-c5a285d62318" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.707434] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e2f14ed1-21b8-4d1e-b6bc-559e167b9967',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.764717] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.764717] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.764819] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.765779] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.765779] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.765779] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5e76d42e-7ec6-4a5e-aa9c-c5a285d62318 is going to be updated. [ 732.803742] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.803742] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.803742] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.803742] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.804237] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.814989] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5e76d42e-7ec6-4a5e-aa9c-c5a285d62318 in Status: IN_PROGRESS for 2s [ 733.016345] env[69188]: INFO networking_nsxv3.common.synchronization [req-d52f0304-3719-4a81-b0a4-2eafad7c8de9 req-a5826f06-0a80-43b2-bace-578268cdfc08 service nova] Enqueued Resource ID: 5e76d42e-7ec6-4a5e-aa9c-c5a285d62318 with Priority: HIGHEST for action security_group_rules [ 733.016577] env[69188]: INFO networking_nsxv3.common.synchronization [req-d52f0304-3719-4a81-b0a4-2eafad7c8de9 req-a5826f06-0a80-43b2-bace-578268cdfc08 service nova] Enqueued Resource ID: 5e76d42e-7ec6-4a5e-aa9c-c5a285d62318 with Priority: HIGHEST for action security_group_members [ 733.016740] env[69188]: INFO networking_nsxv3.common.synchronization [req-d52f0304-3719-4a81-b0a4-2eafad7c8de9 req-a5826f06-0a80-43b2-bace-578268cdfc08 service nova] Enqueued Resource ID: 8551820f-a746-4b28-b9c8-fa47765128d1 with Priority: HIGHEST for action port [ 733.017254] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e76d42e-7ec6-4a5e-aa9c-c5a285d62318 with Priority: HIGHEST for action security_group_rules [ 733.018677] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e76d42e-7ec6-4a5e-aa9c-c5a285d62318 with Priority: HIGHEST for action security_group_members [ 733.023754] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8551820f-a746-4b28-b9c8-fa47765128d1 with Priority: HIGHEST for action port [ 733.023754] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5e76d42e-7ec6-4a5e-aa9c-c5a285d62318 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.023754] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5e76d42e-7ec6-4a5e-aa9c-c5a285d62318" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.023754] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5e76d42e-7ec6-4a5e-aa9c-c5a285d62318" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.023754] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5e76d42e-7ec6-4a5e-aa9c-c5a285d62318" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.023754] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5e76d42e-7ec6-4a5e-aa9c-c5a285d62318',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.027091] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e76d42e-7ec6-4a5e-aa9c-c5a285d62318 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.027091] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e76d42e-7ec6-4a5e-aa9c-c5a285d62318" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.027091] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-8551820f-a746-4b28-b9c8-fa47765128d1 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.027091] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8551820f-a746-4b28-b9c8-fa47765128d1" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.027091] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8551820f-a746-4b28-b9c8-fa47765128d1" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.027091] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8551820f-a746-4b28-b9c8-fa47765128d1" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.027091] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8551820f-a746-4b28-b9c8-fa47765128d1',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.210417] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e2f14ed1-21b8-4d1e-b6bc-559e167b9967',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.531766] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e76d42e-7ec6-4a5e-aa9c-c5a285d62318 taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.531836] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e76d42e-7ec6-4a5e-aa9c-c5a285d62318" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.532032] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8551820f-a746-4b28-b9c8-fa47765128d1 with status ACTIVE [ 733.532156] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.532260] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.532326] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.532588] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.532615] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.532783] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.532851] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.532910] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.533071] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.533149] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.533321] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.533409] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.533468] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.533599] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.533672] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.533751] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8551820f-a746-4b28-b9c8-fa47765128d1 is going to be updated. [ 733.552630] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.553253] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.553341] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.553547] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.553682] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.553834] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8551820f-a746-4b28-b9c8-fa47765128d1" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.713782] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.714745] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.714845] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.715105] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.715231] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.715347] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e2f14ed1-21b8-4d1e-b6bc-559e167b9967 is going to be updated. [ 733.746345] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.746490] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.746563] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.746791] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.746918] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.759902] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e2f14ed1-21b8-4d1e-b6bc-559e167b9967 in Status: IN_PROGRESS for 2s [ 733.993080] env[69188]: INFO networking_nsxv3.common.synchronization [req-3afe86f1-aedf-4c49-86ad-85f5d5f0fde8 req-815d07bf-d72d-4d55-a62c-29819df3c28e tempest-FloatingIPsAssociationTestJSON-209902533 tempest-FloatingIPsAssociationTestJSON-209902533-project-member] Enqueued Resource ID: 53b2b927-2e3d-4111-b25a-7b34ab9fa28d with Priority: HIGHEST for action security_group_members [ 733.993733] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 53b2b927-2e3d-4111-b25a-7b34ab9fa28d with Priority: HIGHEST for action security_group_members [ 733.994114] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-53b2b927-2e3d-4111-b25a-7b34ab9fa28d taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.994298] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-53b2b927-2e3d-4111-b25a-7b34ab9fa28d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.994413] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-53b2b927-2e3d-4111-b25a-7b34ab9fa28d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.994712] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-53b2b927-2e3d-4111-b25a-7b34ab9fa28d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.994962] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.995110] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.995222] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.995444] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.995584] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.995721] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('53b2b927-2e3d-4111-b25a-7b34ab9fa28d',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.353290] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 24a7b083-b432-46d6-94de-76adf6ce22b3 in Status: SUCCESS [ 734.353626] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-24a7b083-b432-46d6-94de-76adf6ce22b3" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.353807] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-24a7b083-b432-46d6-94de-76adf6ce22b3" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.354060] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-24a7b083-b432-46d6-94de-76adf6ce22b3" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.354256] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.354375] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.354440] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.354587] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.354677] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.354746] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-24a7b083-b432-46d6-94de-76adf6ce22b3" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.354844] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('24a7b083-b432-46d6-94de-76adf6ce22b3',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.498143] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('53b2b927-2e3d-4111-b25a-7b34ab9fa28d',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.826400] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5e76d42e-7ec6-4a5e-aa9c-c5a285d62318 in Status: SUCCESS [ 734.826400] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e76d42e-7ec6-4a5e-aa9c-c5a285d62318" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.826517] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e76d42e-7ec6-4a5e-aa9c-c5a285d62318" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.826683] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e76d42e-7ec6-4a5e-aa9c-c5a285d62318" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.826884] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.827035] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.827099] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.827281] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.827369] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.827480] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5e76d42e-7ec6-4a5e-aa9c-c5a285d62318',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.857974] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-24a7b083-b432-46d6-94de-76adf6ce22b3 taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.857974] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-24a7b083-b432-46d6-94de-76adf6ce22b3" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.857974] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-24a7b083-b432-46d6-94de-76adf6ce22b3" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.858144] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-24a7b083-b432-46d6-94de-76adf6ce22b3" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.858329] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.858434] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.858517] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.858647] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.858729] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.859071] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-24a7b083-b432-46d6-94de-76adf6ce22b3" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.859296] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-24a7b083-b432-46d6-94de-76adf6ce22b3 taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.859409] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-24a7b083-b432-46d6-94de-76adf6ce22b3" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.859474] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-24a7b083-b432-46d6-94de-76adf6ce22b3" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.859638] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-24a7b083-b432-46d6-94de-76adf6ce22b3" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.859794] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.859883] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.859924] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.860072] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.860150] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.860231] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-24a7b083-b432-46d6-94de-76adf6ce22b3" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.860355] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('24a7b083-b432-46d6-94de-76adf6ce22b3',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.005517] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('53b2b927-2e3d-4111-b25a-7b34ab9fa28d',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.329825] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5e76d42e-7ec6-4a5e-aa9c-c5a285d62318',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.362581] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 24a7b083-b432-46d6-94de-76adf6ce22b3: rpc.has_security_group_logging(os_id): False [ 735.380536] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.380655] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.380690] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.380899] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.381013] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.381243] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.381325] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.381325] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.381642] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.381642] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.381806] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.381806] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.381897] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.382087] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.382181] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.382426] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.382509] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.382581] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.382721] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.382811] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.382873] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 24a7b083-b432-46d6-94de-76adf6ce22b3 is going to be created. [ 735.513088] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.513088] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.513088] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.513088] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.513088] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.513088] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 53b2b927-2e3d-4111-b25a-7b34ab9fa28d is going to be updated. [ 735.543714] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.543714] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.543714] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.543714] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.543714] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.554962] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 24a7b083-b432-46d6-94de-76adf6ce22b3 in Status: IN_PROGRESS for 2s [ 735.569716] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.569716] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.569716] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.569716] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.569716] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.579934] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 53b2b927-2e3d-4111-b25a-7b34ab9fa28d in Status: IN_PROGRESS for 2s [ 735.770720] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e2f14ed1-21b8-4d1e-b6bc-559e167b9967 in Status: SUCCESS [ 735.770720] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2f14ed1-21b8-4d1e-b6bc-559e167b9967" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.832952] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5e76d42e-7ec6-4a5e-aa9c-c5a285d62318',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.335603] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.335875] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.335875] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.336067] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.336166] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.336264] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5e76d42e-7ec6-4a5e-aa9c-c5a285d62318 is going to be updated. [ 736.367135] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.367135] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.367135] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.367135] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.367135] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.373253] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5e76d42e-7ec6-4a5e-aa9c-c5a285d62318 in Status: IN_PROGRESS for 2s [ 737.568258] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 24a7b083-b432-46d6-94de-76adf6ce22b3 in Status: SUCCESS [ 737.569585] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-24a7b083-b432-46d6-94de-76adf6ce22b3" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.587910] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 53b2b927-2e3d-4111-b25a-7b34ab9fa28d in Status: SUCCESS [ 737.588342] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-53b2b927-2e3d-4111-b25a-7b34ab9fa28d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.387055] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5e76d42e-7ec6-4a5e-aa9c-c5a285d62318 in Status: SUCCESS [ 738.388032] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e76d42e-7ec6-4a5e-aa9c-c5a285d62318" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.388032] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e76d42e-7ec6-4a5e-aa9c-c5a285d62318" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.388032] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e76d42e-7ec6-4a5e-aa9c-c5a285d62318" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.388032] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.388231] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.388231] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.388382] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.388476] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.388542] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e76d42e-7ec6-4a5e-aa9c-c5a285d62318" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.388630] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5e76d42e-7ec6-4a5e-aa9c-c5a285d62318',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.891368] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e76d42e-7ec6-4a5e-aa9c-c5a285d62318 taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.891740] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e76d42e-7ec6-4a5e-aa9c-c5a285d62318" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.891740] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e76d42e-7ec6-4a5e-aa9c-c5a285d62318" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.891843] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e76d42e-7ec6-4a5e-aa9c-c5a285d62318" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.891968] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.892093] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.892160] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.892339] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.892431] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.892519] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e76d42e-7ec6-4a5e-aa9c-c5a285d62318" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.892667] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e76d42e-7ec6-4a5e-aa9c-c5a285d62318 taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.892759] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e76d42e-7ec6-4a5e-aa9c-c5a285d62318" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.892818] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e76d42e-7ec6-4a5e-aa9c-c5a285d62318" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.892961] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e76d42e-7ec6-4a5e-aa9c-c5a285d62318" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.893123] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.893215] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.893279] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.893410] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.893515] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.893597] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e76d42e-7ec6-4a5e-aa9c-c5a285d62318" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.893702] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5e76d42e-7ec6-4a5e-aa9c-c5a285d62318',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.994752] env[69188]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 738.994857] env[69188]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 739.401948] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5e76d42e-7ec6-4a5e-aa9c-c5a285d62318: rpc.has_security_group_logging(os_id): False [ 739.419542] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.419722] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.419756] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.419967] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.420075] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.420270] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.420369] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.420431] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.420588] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.421085] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.421085] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.421085] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.421085] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.421250] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.421277] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.421485] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.422197] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.422318] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.423309] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.423309] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.423309] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5e76d42e-7ec6-4a5e-aa9c-c5a285d62318 is going to be updated. [ 739.482073] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.482476] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.482476] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.482681] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.482877] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.498758] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5e76d42e-7ec6-4a5e-aa9c-c5a285d62318 in Status: IN_PROGRESS for 2s [ 740.937130] env[69188]: INFO networking_nsxv3.common.synchronization [None req-9cd8f8b5-53e0-459c-9f0d-7655c2f1c0c1 None None] Enqueued Resource ID: 2f1469ca-9994-466c-9490-02e344097171 with Priority: HIGHEST for action port [ 740.937411] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f1469ca-9994-466c-9490-02e344097171 with Priority: HIGHEST for action port [ 740.938227] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-2f1469ca-9994-466c-9490-02e344097171 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.938227] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2f1469ca-9994-466c-9490-02e344097171" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.938227] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2f1469ca-9994-466c-9490-02e344097171" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.938430] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2f1469ca-9994-466c-9490-02e344097171" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.938502] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2f1469ca-9994-466c-9490-02e344097171',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.441370] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2f1469ca-9994-466c-9490-02e344097171 [ 741.441749] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.441749] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.441938] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.442195] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.442317] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.442418] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2f1469ca-9994-466c-9490-02e344097171 already deleted. [ 741.442500] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2f1469ca-9994-466c-9490-02e344097171" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.521029] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5e76d42e-7ec6-4a5e-aa9c-c5a285d62318 in Status: SUCCESS [ 741.521029] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5e76d42e-7ec6-4a5e-aa9c-c5a285d62318" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.831618] env[69188]: INFO networking_nsxv3.common.synchronization [req-6140b5cc-3f37-4898-a85b-41570a24a79b req-de3cc92e-6496-431e-9b7e-f5cc77da40f8 tempest-ServersTestFqdnHostnames-463327493 tempest-ServersTestFqdnHostnames-463327493-project-member] Enqueued Resource ID: 43255fe7-9062-49a0-a8ff-2aab46177272 with Priority: HIGHEST for action security_group_members [ 741.832197] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 43255fe7-9062-49a0-a8ff-2aab46177272 with Priority: HIGHEST for action security_group_members [ 741.832490] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-43255fe7-9062-49a0-a8ff-2aab46177272 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.832605] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-43255fe7-9062-49a0-a8ff-2aab46177272" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.832886] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-43255fe7-9062-49a0-a8ff-2aab46177272" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.832952] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-43255fe7-9062-49a0-a8ff-2aab46177272" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.834346] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.834346] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.834346] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.834346] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.835083] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.835083] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('43255fe7-9062-49a0-a8ff-2aab46177272',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.244321] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock network-311 taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.244671] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "network-311" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.244730] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "network-311" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.248132] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "network-311" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.248465] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.248674] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.248803] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.249106] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.249283] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.249539] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 742.249673] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] NeedRegenerationException {{(pid=69188) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 742.249799] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] no value, waiting for create lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 742.249915] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] value creation lock acquired {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 742.250133] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 742.250262] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Calling creation function for not-yet-present value {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 742.250412] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 742.271203] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 742.271472] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69188) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 742.271532] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Released creation lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 742.271685] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "network-311" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.271990] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock port-5291e09e-156b-45f6-aa8e-58d389b476cd taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.272180] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "port-5291e09e-156b-45f6-aa8e-58d389b476cd" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.272298] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "port-5291e09e-156b-45f6-aa8e-58d389b476cd" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.272910] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "port-5291e09e-156b-45f6-aa8e-58d389b476cd" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.272910] env[69188]: DEBUG networking_nsxv3.api.rpc [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5291e09e-156b-45f6-aa8e-58d389b476cd',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.339176] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.339176] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.339176] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.339176] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.339176] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.339176] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.339176] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.339176] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.339176] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.339176] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.339176] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 43255fe7-9062-49a0-a8ff-2aab46177272 already deleted. [ 742.339176] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-43255fe7-9062-49a0-a8ff-2aab46177272" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.778468] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.778468] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.778582] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.780189] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.780458] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.780579] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Segment Port 5291e09e-156b-45f6-aa8e-58d389b476cd not found, creating... [ 742.780841] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.781022] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.781146] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.781397] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.781537] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.781857] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.787164] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.787354] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.787620] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.787759] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.787923] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Resource: SegmentPort with ID: 5291e09e-156b-45f6-aa8e-58d389b476cd is going to be created. [ 742.806875] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.807124] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.807261] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.807534] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.807763] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.808051] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "port-5291e09e-156b-45f6-aa8e-58d389b476cd" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.860249] env[69188]: INFO networking_nsxv3.common.synchronization [None req-31d8db36-6de6-43e7-8f56-9fabeb81230b None None] Enqueued Resource ID: 9b5fad0b-a86c-47fd-87f8-8edec3ec93a1 with Priority: HIGHEST for action port [ 742.860249] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b5fad0b-a86c-47fd-87f8-8edec3ec93a1 with Priority: HIGHEST for action port [ 742.860249] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-9b5fad0b-a86c-47fd-87f8-8edec3ec93a1 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.860546] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9b5fad0b-a86c-47fd-87f8-8edec3ec93a1" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.860546] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9b5fad0b-a86c-47fd-87f8-8edec3ec93a1" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.860651] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9b5fad0b-a86c-47fd-87f8-8edec3ec93a1" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.860712] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9b5fad0b-a86c-47fd-87f8-8edec3ec93a1',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.365571] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9b5fad0b-a86c-47fd-87f8-8edec3ec93a1 [ 743.365571] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.365571] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.365571] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.365571] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.365571] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.365571] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9b5fad0b-a86c-47fd-87f8-8edec3ec93a1 already deleted. [ 743.365571] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9b5fad0b-a86c-47fd-87f8-8edec3ec93a1" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.566540] env[69188]: INFO networking_nsxv3.common.synchronization [req-6140b5cc-3f37-4898-a85b-41570a24a79b req-799414d0-53e0-42ae-816c-308b906ae471 service nova] Enqueued Resource ID: 43255fe7-9062-49a0-a8ff-2aab46177272 with Priority: HIGHEST for action security_group_rules [ 743.566800] env[69188]: INFO networking_nsxv3.common.synchronization [req-6140b5cc-3f37-4898-a85b-41570a24a79b req-799414d0-53e0-42ae-816c-308b906ae471 service nova] Enqueued Resource ID: 43255fe7-9062-49a0-a8ff-2aab46177272 with Priority: HIGHEST for action security_group_members [ 743.567053] env[69188]: INFO networking_nsxv3.common.synchronization [req-6140b5cc-3f37-4898-a85b-41570a24a79b req-799414d0-53e0-42ae-816c-308b906ae471 service nova] Enqueued Resource ID: 5291e09e-156b-45f6-aa8e-58d389b476cd with Priority: HIGHEST for action port [ 743.567220] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 43255fe7-9062-49a0-a8ff-2aab46177272 with Priority: HIGHEST for action security_group_rules [ 743.567352] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 43255fe7-9062-49a0-a8ff-2aab46177272 with Priority: HIGHEST for action security_group_members [ 743.567445] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5291e09e-156b-45f6-aa8e-58d389b476cd with Priority: HIGHEST for action port [ 743.567965] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-43255fe7-9062-49a0-a8ff-2aab46177272 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.568166] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-43255fe7-9062-49a0-a8ff-2aab46177272" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.568226] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-43255fe7-9062-49a0-a8ff-2aab46177272" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.568418] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-43255fe7-9062-49a0-a8ff-2aab46177272" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.568500] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('43255fe7-9062-49a0-a8ff-2aab46177272',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.571565] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-43255fe7-9062-49a0-a8ff-2aab46177272 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.571693] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-43255fe7-9062-49a0-a8ff-2aab46177272" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.571762] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-43255fe7-9062-49a0-a8ff-2aab46177272" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.571943] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-43255fe7-9062-49a0-a8ff-2aab46177272" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.572132] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.572232] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.572295] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.572442] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.572526] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.572613] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('43255fe7-9062-49a0-a8ff-2aab46177272',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.573389] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-5291e09e-156b-45f6-aa8e-58d389b476cd taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.573484] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5291e09e-156b-45f6-aa8e-58d389b476cd" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.573554] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5291e09e-156b-45f6-aa8e-58d389b476cd" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.573704] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5291e09e-156b-45f6-aa8e-58d389b476cd" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.573778] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5291e09e-156b-45f6-aa8e-58d389b476cd',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.081304] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-43255fe7-9062-49a0-a8ff-2aab46177272 taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.081439] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-43255fe7-9062-49a0-a8ff-2aab46177272" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.081598] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('43255fe7-9062-49a0-a8ff-2aab46177272',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.085489] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5291e09e-156b-45f6-aa8e-58d389b476cd with status ACTIVE [ 744.085676] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.085801] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.085868] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.086101] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.086181] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.086360] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.086451] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.086513] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.086662] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.086737] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.086913] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.086999] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.087225] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.087277] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.087356] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.087446] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5291e09e-156b-45f6-aa8e-58d389b476cd is going to be updated. [ 744.106830] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.106969] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.107076] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.111026] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.111026] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.111026] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5291e09e-156b-45f6-aa8e-58d389b476cd" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.587468] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('43255fe7-9062-49a0-a8ff-2aab46177272',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.090268] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.090420] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.090502] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.090716] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.090807] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.090908] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 43255fe7-9062-49a0-a8ff-2aab46177272 is going to be created. [ 745.112993] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.113133] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.113200] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.113407] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.113561] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.122928] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 43255fe7-9062-49a0-a8ff-2aab46177272 in Status: UNINITIALIZED for 2s [ 745.430475] env[69188]: INFO networking_nsxv3.common.synchronization [req-9b9726be-da95-4907-8a6e-29c518ee10d6 req-03aa7923-7d71-451f-b7b8-48d467ddadc8 tempest-ServersAdminNegativeTestJSON-68746947 tempest-ServersAdminNegativeTestJSON-68746947-project-member] Enqueued Resource ID: b8569476-f644-46f4-87dc-5a1d19af31a2 with Priority: HIGHEST for action security_group_members [ 745.430670] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8569476-f644-46f4-87dc-5a1d19af31a2 with Priority: HIGHEST for action security_group_members [ 745.430988] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8569476-f644-46f4-87dc-5a1d19af31a2 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.431257] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8569476-f644-46f4-87dc-5a1d19af31a2" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.431257] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8569476-f644-46f4-87dc-5a1d19af31a2" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.431391] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8569476-f644-46f4-87dc-5a1d19af31a2" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.431539] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.431631] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.431692] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.431857] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.431941] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.432053] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b8569476-f644-46f4-87dc-5a1d19af31a2',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.933856] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.934150] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.934150] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.934261] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.934357] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.934547] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.934643] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.934700] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.934852] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.934930] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.935045] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b8569476-f644-46f4-87dc-5a1d19af31a2 is going to be updated. [ 745.960819] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.960946] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.961039] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.961214] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.961346] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.968858] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b8569476-f644-46f4-87dc-5a1d19af31a2 in Status: IN_PROGRESS for 2s [ 746.480349] env[69188]: INFO networking_nsxv3.common.synchronization [req-9c5e4f34-b58f-47e7-8076-2ec88c9e5a60 req-eea35a44-d245-4699-9c1f-8b230e2c70d9 tempest-DeleteServersTestJSON-857706435 tempest-DeleteServersTestJSON-857706435-project-member] Enqueued Resource ID: 397559b2-3c5a-424d-b09d-43a25d2abba6 with Priority: HIGHEST for action security_group_members [ 746.480349] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 397559b2-3c5a-424d-b09d-43a25d2abba6 with Priority: HIGHEST for action security_group_members [ 746.480823] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-397559b2-3c5a-424d-b09d-43a25d2abba6 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.480823] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-397559b2-3c5a-424d-b09d-43a25d2abba6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.480823] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-397559b2-3c5a-424d-b09d-43a25d2abba6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.480988] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-397559b2-3c5a-424d-b09d-43a25d2abba6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.481084] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.481175] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.481232] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.481372] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.481450] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.481536] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('397559b2-3c5a-424d-b09d-43a25d2abba6',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.804554] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock network-449 taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.804755] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "network-449" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.804879] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "network-449" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.805191] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "network-449" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.805431] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.805589] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.805705] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.805912] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.806070] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.806269] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 746.806416] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] NeedRegenerationException {{(pid=69188) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 746.806690] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] no value, waiting for create lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 746.806725] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] value creation lock acquired {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 746.806824] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 746.806930] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Calling creation function for not-yet-present value {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 746.807482] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 746.825773] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 746.825920] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69188) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 746.826079] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Released creation lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 746.826247] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "network-449" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.826530] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock port-2a6e76e1-2539-4f3d-9e2f-488c2c18f3a7 taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.826920] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "port-2a6e76e1-2539-4f3d-9e2f-488c2c18f3a7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.826920] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "port-2a6e76e1-2539-4f3d-9e2f-488c2c18f3a7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.827141] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "port-2a6e76e1-2539-4f3d-9e2f-488c2c18f3a7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.827266] env[69188]: DEBUG networking_nsxv3.api.rpc [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2a6e76e1-2539-4f3d-9e2f-488c2c18f3a7',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.985309] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.985596] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.985596] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.985781] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.985876] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.986090] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.986188] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.986254] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.986400] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.986475] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.986561] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 397559b2-3c5a-424d-b09d-43a25d2abba6 is going to be updated. [ 747.010141] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.010279] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.010357] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.010564] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.010701] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.019033] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 397559b2-3c5a-424d-b09d-43a25d2abba6 in Status: IN_PROGRESS for 2s [ 747.133334] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 43255fe7-9062-49a0-a8ff-2aab46177272 in Status: SUCCESS [ 747.133557] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-43255fe7-9062-49a0-a8ff-2aab46177272" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.133695] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-43255fe7-9062-49a0-a8ff-2aab46177272" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.133907] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-43255fe7-9062-49a0-a8ff-2aab46177272" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.134110] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.134224] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.134287] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.134428] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.134509] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.134667] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-43255fe7-9062-49a0-a8ff-2aab46177272" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.134803] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('43255fe7-9062-49a0-a8ff-2aab46177272',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.329636] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.329858] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.329986] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.330315] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.330448] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.330597] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Segment Port 2a6e76e1-2539-4f3d-9e2f-488c2c18f3a7 not found, creating... [ 747.330848] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.331012] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.331139] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.331348] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.331485] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.331767] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.331918] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.332043] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.332263] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.332388] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.332524] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Resource: SegmentPort with ID: 2a6e76e1-2539-4f3d-9e2f-488c2c18f3a7 is going to be created. [ 747.350323] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.350498] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.350619] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.350838] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.351070] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.351282] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "port-2a6e76e1-2539-4f3d-9e2f-488c2c18f3a7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.637876] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('43255fe7-9062-49a0-a8ff-2aab46177272',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.978409] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b8569476-f644-46f4-87dc-5a1d19af31a2 in Status: SUCCESS [ 747.978579] env[69188]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b8569476-f644-46f4-87dc-5a1d19af31a2 deletion is rescheduled due to dependency. [ 747.978692] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8569476-f644-46f4-87dc-5a1d19af31a2" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.095878] env[69188]: INFO networking_nsxv3.common.synchronization [req-9c5e4f34-b58f-47e7-8076-2ec88c9e5a60 req-a0008cbd-e0b9-494c-99ae-128ef08c3445 service nova] Enqueued Resource ID: 397559b2-3c5a-424d-b09d-43a25d2abba6 with Priority: HIGHEST for action security_group_rules [ 748.096137] env[69188]: INFO networking_nsxv3.common.synchronization [req-9c5e4f34-b58f-47e7-8076-2ec88c9e5a60 req-a0008cbd-e0b9-494c-99ae-128ef08c3445 service nova] Enqueued Resource ID: 397559b2-3c5a-424d-b09d-43a25d2abba6 with Priority: HIGHEST for action security_group_members [ 748.096211] env[69188]: INFO networking_nsxv3.common.synchronization [req-9c5e4f34-b58f-47e7-8076-2ec88c9e5a60 req-a0008cbd-e0b9-494c-99ae-128ef08c3445 service nova] Enqueued Resource ID: 2a6e76e1-2539-4f3d-9e2f-488c2c18f3a7 with Priority: HIGHEST for action port [ 748.096436] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 397559b2-3c5a-424d-b09d-43a25d2abba6 with Priority: HIGHEST for action security_group_rules [ 748.096563] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 397559b2-3c5a-424d-b09d-43a25d2abba6 with Priority: HIGHEST for action security_group_members [ 748.096658] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2a6e76e1-2539-4f3d-9e2f-488c2c18f3a7 with Priority: HIGHEST for action port [ 748.097429] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-397559b2-3c5a-424d-b09d-43a25d2abba6 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.097806] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-397559b2-3c5a-424d-b09d-43a25d2abba6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.097806] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-397559b2-3c5a-424d-b09d-43a25d2abba6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.097806] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-397559b2-3c5a-424d-b09d-43a25d2abba6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.097998] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('397559b2-3c5a-424d-b09d-43a25d2abba6',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.102072] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-397559b2-3c5a-424d-b09d-43a25d2abba6 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.102197] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-397559b2-3c5a-424d-b09d-43a25d2abba6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.102405] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-2a6e76e1-2539-4f3d-9e2f-488c2c18f3a7 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.102510] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2a6e76e1-2539-4f3d-9e2f-488c2c18f3a7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.102575] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2a6e76e1-2539-4f3d-9e2f-488c2c18f3a7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.102747] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2a6e76e1-2539-4f3d-9e2f-488c2c18f3a7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.102822] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2a6e76e1-2539-4f3d-9e2f-488c2c18f3a7',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.139728] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 43255fe7-9062-49a0-a8ff-2aab46177272: rpc.has_security_group_logging(os_id): False [ 748.156569] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.156707] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.156773] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.156952] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.157060] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.157318] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.157438] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.157496] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.157627] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.157702] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.157784] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 43255fe7-9062-49a0-a8ff-2aab46177272 is going to be created. [ 748.209957] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.210192] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.210260] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.210547] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.210724] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.222534] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 43255fe7-9062-49a0-a8ff-2aab46177272 in Status: IN_PROGRESS for 2s [ 748.605366] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-397559b2-3c5a-424d-b09d-43a25d2abba6 taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.605620] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-397559b2-3c5a-424d-b09d-43a25d2abba6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.605914] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2a6e76e1-2539-4f3d-9e2f-488c2c18f3a7 with status ACTIVE [ 748.606209] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.606381] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.606486] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.606791] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.606936] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.607233] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.607386] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.607498] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.608039] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.608157] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.608454] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.608608] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.609029] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.609273] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.609409] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.609682] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2a6e76e1-2539-4f3d-9e2f-488c2c18f3a7 is going to be updated. [ 748.632175] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.632333] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.632376] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.632591] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.632729] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.632865] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2a6e76e1-2539-4f3d-9e2f-488c2c18f3a7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.000225] env[69188]: INFO networking_nsxv3.common.synchronization [req-a95695da-28f2-43f3-8c85-2c952326164d req-c8b53fd4-6b20-4c8f-bb5f-54054274952f tempest-TenantUsagesTestJSON-744140899 tempest-TenantUsagesTestJSON-744140899-project-member] Enqueued Resource ID: 86b3e666-35a3-418a-82c9-eb305c030ea1 with Priority: HIGHEST for action security_group_members [ 749.000225] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 86b3e666-35a3-418a-82c9-eb305c030ea1 with Priority: HIGHEST for action security_group_members [ 749.000225] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-86b3e666-35a3-418a-82c9-eb305c030ea1 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.000225] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-86b3e666-35a3-418a-82c9-eb305c030ea1" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.000225] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-86b3e666-35a3-418a-82c9-eb305c030ea1" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.000225] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-86b3e666-35a3-418a-82c9-eb305c030ea1" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.000225] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.000225] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.000225] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.000225] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.000225] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.001711] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('86b3e666-35a3-418a-82c9-eb305c030ea1',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.030586] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 397559b2-3c5a-424d-b09d-43a25d2abba6 in Status: SUCCESS [ 749.030891] env[69188]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 397559b2-3c5a-424d-b09d-43a25d2abba6 deletion is rescheduled due to dependency. [ 749.031149] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-397559b2-3c5a-424d-b09d-43a25d2abba6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.033034] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-397559b2-3c5a-424d-b09d-43a25d2abba6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.033034] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-397559b2-3c5a-424d-b09d-43a25d2abba6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.033034] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.033034] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.033034] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.033034] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.033034] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.033351] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('397559b2-3c5a-424d-b09d-43a25d2abba6',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.503418] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.503736] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.503736] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.503856] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.503945] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.504153] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.504249] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.504310] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.504457] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.504533] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.504618] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 86b3e666-35a3-418a-82c9-eb305c030ea1 already deleted. [ 749.504689] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-86b3e666-35a3-418a-82c9-eb305c030ea1" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.536676] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('397559b2-3c5a-424d-b09d-43a25d2abba6',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.568592] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock network-267 taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.568750] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "network-267" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.572269] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "network-267" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.572554] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "network-267" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.572841] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.572999] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.573181] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.573399] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.573549] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.573753] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 749.573867] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] NeedRegenerationException {{(pid=69188) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 749.573977] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] no value, waiting for create lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 749.574100] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] value creation lock acquired {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 749.574209] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 749.574313] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Calling creation function for not-yet-present value {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 749.574443] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 749.595683] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 749.595849] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69188) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 749.595982] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Released creation lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 749.596781] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "network-267" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.596781] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock port-0ae028be-515e-41ed-98f5-8ad0f03ea8fd taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.596781] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "port-0ae028be-515e-41ed-98f5-8ad0f03ea8fd" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.596985] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "port-0ae028be-515e-41ed-98f5-8ad0f03ea8fd" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.597194] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "port-0ae028be-515e-41ed-98f5-8ad0f03ea8fd" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.597340] env[69188]: DEBUG networking_nsxv3.api.rpc [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0ae028be-515e-41ed-98f5-8ad0f03ea8fd',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 750.040901] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('397559b2-3c5a-424d-b09d-43a25d2abba6',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 750.100577] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.100846] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.100938] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.101241] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.101398] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.101556] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Segment Port 0ae028be-515e-41ed-98f5-8ad0f03ea8fd not found, creating... [ 750.101838] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.102030] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.102155] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.102378] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.102538] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.102794] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.103033] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.103090] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.103620] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.103620] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.103620] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Resource: SegmentPort with ID: 0ae028be-515e-41ed-98f5-8ad0f03ea8fd is going to be created. [ 750.125209] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.125209] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.125209] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.125209] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.125209] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.125209] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "port-0ae028be-515e-41ed-98f5-8ad0f03ea8fd" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.237134] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 43255fe7-9062-49a0-a8ff-2aab46177272 in Status: SUCCESS [ 750.237134] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-43255fe7-9062-49a0-a8ff-2aab46177272" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.543358] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.543688] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.543688] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.543799] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.543885] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.543980] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 397559b2-3c5a-424d-b09d-43a25d2abba6 is going to be updated. [ 750.568452] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.568615] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.568673] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.568881] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.569019] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.575861] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 397559b2-3c5a-424d-b09d-43a25d2abba6 in Status: IN_PROGRESS for 2s [ 750.888360] env[69188]: INFO networking_nsxv3.common.synchronization [req-a95695da-28f2-43f3-8c85-2c952326164d req-c46bffc1-5c67-4ed0-9fab-9cca4468aabd service nova] Enqueued Resource ID: 86b3e666-35a3-418a-82c9-eb305c030ea1 with Priority: HIGHEST for action security_group_rules [ 750.888542] env[69188]: INFO networking_nsxv3.common.synchronization [req-a95695da-28f2-43f3-8c85-2c952326164d req-c46bffc1-5c67-4ed0-9fab-9cca4468aabd service nova] Enqueued Resource ID: 86b3e666-35a3-418a-82c9-eb305c030ea1 with Priority: HIGHEST for action security_group_members [ 750.888684] env[69188]: INFO networking_nsxv3.common.synchronization [req-a95695da-28f2-43f3-8c85-2c952326164d req-c46bffc1-5c67-4ed0-9fab-9cca4468aabd service nova] Enqueued Resource ID: 0ae028be-515e-41ed-98f5-8ad0f03ea8fd with Priority: HIGHEST for action port [ 750.888903] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 86b3e666-35a3-418a-82c9-eb305c030ea1 with Priority: HIGHEST for action security_group_rules [ 750.889048] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 86b3e666-35a3-418a-82c9-eb305c030ea1 with Priority: HIGHEST for action security_group_members [ 750.889160] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0ae028be-515e-41ed-98f5-8ad0f03ea8fd with Priority: HIGHEST for action port [ 750.889708] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-86b3e666-35a3-418a-82c9-eb305c030ea1 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.889834] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-86b3e666-35a3-418a-82c9-eb305c030ea1" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.889898] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-86b3e666-35a3-418a-82c9-eb305c030ea1" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.890400] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-86b3e666-35a3-418a-82c9-eb305c030ea1" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.890517] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('86b3e666-35a3-418a-82c9-eb305c030ea1',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 750.893323] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-86b3e666-35a3-418a-82c9-eb305c030ea1 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.893323] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-86b3e666-35a3-418a-82c9-eb305c030ea1" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.893323] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-86b3e666-35a3-418a-82c9-eb305c030ea1" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.893323] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-86b3e666-35a3-418a-82c9-eb305c030ea1" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.893323] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.893323] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.893323] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.893323] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.893323] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.893323] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('86b3e666-35a3-418a-82c9-eb305c030ea1',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 750.896062] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-0ae028be-515e-41ed-98f5-8ad0f03ea8fd taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.896062] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0ae028be-515e-41ed-98f5-8ad0f03ea8fd" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.896062] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0ae028be-515e-41ed-98f5-8ad0f03ea8fd" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.896062] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0ae028be-515e-41ed-98f5-8ad0f03ea8fd" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.896062] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0ae028be-515e-41ed-98f5-8ad0f03ea8fd',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.399029] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0ae028be-515e-41ed-98f5-8ad0f03ea8fd with status ACTIVE [ 751.399029] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.399315] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.399315] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.399514] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.399548] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.399709] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.399809] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.399872] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.400043] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.400131] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.400315] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.400408] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.400469] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.400606] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.400681] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.400763] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0ae028be-515e-41ed-98f5-8ad0f03ea8fd is going to be updated. [ 751.401826] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('86b3e666-35a3-418a-82c9-eb305c030ea1',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.405021] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-86b3e666-35a3-418a-82c9-eb305c030ea1 taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.405021] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-86b3e666-35a3-418a-82c9-eb305c030ea1" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.420839] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.420979] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.421058] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.421225] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.421357] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.421501] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0ae028be-515e-41ed-98f5-8ad0f03ea8fd" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.506801] env[69188]: INFO networking_nsxv3.common.synchronization [req-0bff398a-6df1-4c7e-acf6-c9f053b4fc9e req-032e1c75-e47b-4d13-8e20-d1011c45f1b9 tempest-MultipleCreateTestJSON-27366217 tempest-MultipleCreateTestJSON-27366217-project-member] Enqueued Resource ID: 7f98bc00-dbd3-411c-a67a-14369145489a with Priority: HIGHEST for action security_group_members [ 751.507519] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f98bc00-dbd3-411c-a67a-14369145489a with Priority: HIGHEST for action security_group_members [ 751.507996] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-7f98bc00-dbd3-411c-a67a-14369145489a taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.507996] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7f98bc00-dbd3-411c-a67a-14369145489a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.508120] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7f98bc00-dbd3-411c-a67a-14369145489a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.508384] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7f98bc00-dbd3-411c-a67a-14369145489a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.508554] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.509052] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.509123] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.509281] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.509372] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.509470] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7f98bc00-dbd3-411c-a67a-14369145489a',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.845250] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock network-434 taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.845531] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "network-434" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.845571] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "network-434" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.845887] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "network-434" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.846166] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.846320] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.846432] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.846636] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.846774] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.846969] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 751.847329] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] NeedRegenerationException {{(pid=69188) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 751.847458] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] no value, waiting for create lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 751.847573] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] value creation lock acquired {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 751.847683] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 751.847787] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Calling creation function for not-yet-present value {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 751.847918] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 751.865789] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 751.865945] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69188) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 751.866092] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Released creation lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 751.866264] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "network-434" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.866563] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock port-46c8c40a-5348-492e-8a92-0a14ba88772e taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.866728] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "port-46c8c40a-5348-492e-8a92-0a14ba88772e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.866847] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "port-46c8c40a-5348-492e-8a92-0a14ba88772e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.867198] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "port-46c8c40a-5348-492e-8a92-0a14ba88772e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.867340] env[69188]: DEBUG networking_nsxv3.api.rpc [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('46c8c40a-5348-492e-8a92-0a14ba88772e',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.904547] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('86b3e666-35a3-418a-82c9-eb305c030ea1',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 752.011827] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.011983] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.012072] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.012301] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.012387] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.012580] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.012672] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.012732] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.012873] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.012946] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.013042] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7f98bc00-dbd3-411c-a67a-14369145489a already deleted. [ 752.013192] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7f98bc00-dbd3-411c-a67a-14369145489a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.372973] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.373211] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.373361] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.373666] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.373818] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.373971] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Segment Port 46c8c40a-5348-492e-8a92-0a14ba88772e not found, creating... [ 752.374243] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.374402] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.375434] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.375434] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.375434] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.375434] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.375434] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.375619] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.375708] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.375847] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.375947] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Resource: SegmentPort with ID: 46c8c40a-5348-492e-8a92-0a14ba88772e is going to be created. [ 752.394831] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.395012] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.395145] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.395421] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.395650] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.395896] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "port-46c8c40a-5348-492e-8a92-0a14ba88772e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.406709] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.406841] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.407347] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.407347] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.407347] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.407347] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 86b3e666-35a3-418a-82c9-eb305c030ea1 is going to be created. [ 752.430531] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.431922] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.432771] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.432771] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.432771] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.456048] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 86b3e666-35a3-418a-82c9-eb305c030ea1 in Status: UNINITIALIZED for 2s [ 752.587106] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 397559b2-3c5a-424d-b09d-43a25d2abba6 in Status: SUCCESS [ 752.587106] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-397559b2-3c5a-424d-b09d-43a25d2abba6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.587554] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-397559b2-3c5a-424d-b09d-43a25d2abba6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.587638] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-397559b2-3c5a-424d-b09d-43a25d2abba6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.587765] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.587878] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.587942] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.588108] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.588478] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.588478] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-397559b2-3c5a-424d-b09d-43a25d2abba6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.588478] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('397559b2-3c5a-424d-b09d-43a25d2abba6',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.091506] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-397559b2-3c5a-424d-b09d-43a25d2abba6 taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.091831] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-397559b2-3c5a-424d-b09d-43a25d2abba6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.091831] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-397559b2-3c5a-424d-b09d-43a25d2abba6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.093425] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-397559b2-3c5a-424d-b09d-43a25d2abba6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.093425] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.093425] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.093425] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.093425] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.093425] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.093425] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-397559b2-3c5a-424d-b09d-43a25d2abba6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.093425] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-397559b2-3c5a-424d-b09d-43a25d2abba6 taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.093425] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-397559b2-3c5a-424d-b09d-43a25d2abba6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.093425] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-397559b2-3c5a-424d-b09d-43a25d2abba6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.094027] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-397559b2-3c5a-424d-b09d-43a25d2abba6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.094027] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.094027] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.094027] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.094027] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.094027] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.094361] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-397559b2-3c5a-424d-b09d-43a25d2abba6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.094361] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('397559b2-3c5a-424d-b09d-43a25d2abba6',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.153721] env[69188]: INFO networking_nsxv3.common.synchronization [req-0bff398a-6df1-4c7e-acf6-c9f053b4fc9e req-3e8f8926-3527-4690-a1a4-34da56c6e97e service nova] Enqueued Resource ID: 7f98bc00-dbd3-411c-a67a-14369145489a with Priority: HIGHEST for action security_group_rules [ 753.153917] env[69188]: INFO networking_nsxv3.common.synchronization [req-0bff398a-6df1-4c7e-acf6-c9f053b4fc9e req-3e8f8926-3527-4690-a1a4-34da56c6e97e service nova] Enqueued Resource ID: 7f98bc00-dbd3-411c-a67a-14369145489a with Priority: HIGHEST for action security_group_members [ 753.154125] env[69188]: INFO networking_nsxv3.common.synchronization [req-0bff398a-6df1-4c7e-acf6-c9f053b4fc9e req-3e8f8926-3527-4690-a1a4-34da56c6e97e service nova] Enqueued Resource ID: 46c8c40a-5348-492e-8a92-0a14ba88772e with Priority: HIGHEST for action port [ 753.154685] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f98bc00-dbd3-411c-a67a-14369145489a with Priority: HIGHEST for action security_group_rules [ 753.154815] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f98bc00-dbd3-411c-a67a-14369145489a with Priority: HIGHEST for action security_group_members [ 753.154939] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 46c8c40a-5348-492e-8a92-0a14ba88772e with Priority: HIGHEST for action port [ 753.155196] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7f98bc00-dbd3-411c-a67a-14369145489a taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.155627] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7f98bc00-dbd3-411c-a67a-14369145489a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.155627] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7f98bc00-dbd3-411c-a67a-14369145489a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.155627] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7f98bc00-dbd3-411c-a67a-14369145489a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.155759] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7f98bc00-dbd3-411c-a67a-14369145489a',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.156526] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-7f98bc00-dbd3-411c-a67a-14369145489a taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.156637] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7f98bc00-dbd3-411c-a67a-14369145489a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.156704] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7f98bc00-dbd3-411c-a67a-14369145489a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.156864] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7f98bc00-dbd3-411c-a67a-14369145489a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.157043] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.157243] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.157243] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.157418] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.157459] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.157545] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7f98bc00-dbd3-411c-a67a-14369145489a',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.158770] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-46c8c40a-5348-492e-8a92-0a14ba88772e taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.158878] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-46c8c40a-5348-492e-8a92-0a14ba88772e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.158945] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-46c8c40a-5348-492e-8a92-0a14ba88772e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.159116] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-46c8c40a-5348-492e-8a92-0a14ba88772e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.159171] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('46c8c40a-5348-492e-8a92-0a14ba88772e',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.597424] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 397559b2-3c5a-424d-b09d-43a25d2abba6: rpc.has_security_group_logging(os_id): False [ 753.614514] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.614674] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.614779] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.615086] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.615086] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.615355] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.615441] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.615479] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.615710] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.615710] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.615884] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.615967] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.616052] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.616250] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.616361] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.616561] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.616656] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.616765] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.616852] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.616934] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.617062] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 397559b2-3c5a-424d-b09d-43a25d2abba6 is going to be updated. [ 753.660449] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-7f98bc00-dbd3-411c-a67a-14369145489a taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.660596] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7f98bc00-dbd3-411c-a67a-14369145489a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.662192] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7f98bc00-dbd3-411c-a67a-14369145489a',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.662865] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 46c8c40a-5348-492e-8a92-0a14ba88772e with status ACTIVE [ 753.663198] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.663198] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.663198] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.663404] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.663433] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.664125] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.664125] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.664125] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.664125] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.664125] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.664125] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.664354] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.664354] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.664434] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.664507] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.664592] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 46c8c40a-5348-492e-8a92-0a14ba88772e is going to be updated. [ 753.672454] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.672631] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.672679] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.672935] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.673060] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.682442] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 397559b2-3c5a-424d-b09d-43a25d2abba6 in Status: IN_PROGRESS for 2s [ 753.685538] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.685741] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.685741] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.686627] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.686627] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.686627] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-46c8c40a-5348-492e-8a92-0a14ba88772e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.166386] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7f98bc00-dbd3-411c-a67a-14369145489a',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.256670] env[69188]: INFO networking_nsxv3.common.synchronization [req-0bff398a-6df1-4c7e-acf6-c9f053b4fc9e req-0528da8e-4372-4812-8bf8-5c6105e24271 tempest-MultipleCreateTestJSON-27366217 tempest-MultipleCreateTestJSON-27366217-project-member] Enqueued Resource ID: 7f98bc00-dbd3-411c-a67a-14369145489a with Priority: HIGHEST for action security_group_members [ 754.259021] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f98bc00-dbd3-411c-a67a-14369145489a with Priority: HIGHEST for action security_group_members [ 754.259021] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-7f98bc00-dbd3-411c-a67a-14369145489a taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.259021] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7f98bc00-dbd3-411c-a67a-14369145489a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.469263] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 86b3e666-35a3-418a-82c9-eb305c030ea1 in Status: SUCCESS [ 754.469263] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-86b3e666-35a3-418a-82c9-eb305c030ea1" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.469263] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-86b3e666-35a3-418a-82c9-eb305c030ea1" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.469263] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-86b3e666-35a3-418a-82c9-eb305c030ea1" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.469263] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.469263] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.469263] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.469263] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.469263] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.469263] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-86b3e666-35a3-418a-82c9-eb305c030ea1" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.469263] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('86b3e666-35a3-418a-82c9-eb305c030ea1',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.668981] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.669144] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.669233] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.669464] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.669564] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.669673] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7f98bc00-dbd3-411c-a67a-14369145489a is going to be created. [ 754.692922] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.693113] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.693172] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.693341] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.693521] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.702838] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7f98bc00-dbd3-411c-a67a-14369145489a in Status: UNINITIALIZED for 2s [ 754.763031] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock network-434 taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.763250] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "network-434" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.763384] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "network-434" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.763935] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "network-434" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.764055] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.764247] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.764369] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.764618] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.764816] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.765069] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 754.765216] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] NeedRegenerationException {{(pid=69188) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 754.765335] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] no value, waiting for create lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 754.765463] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] value creation lock acquired {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 754.765576] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 754.765682] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Calling creation function for not-yet-present value {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 754.765876] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 754.784374] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 754.784595] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69188) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 754.784741] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Released creation lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 754.784921] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "network-434" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.785326] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock port-93e2a233-96f8-4ae7-8a36-d1f5f72b2afd taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.785563] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "port-93e2a233-96f8-4ae7-8a36-d1f5f72b2afd" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.785691] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "port-93e2a233-96f8-4ae7-8a36-d1f5f72b2afd" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.786052] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "port-93e2a233-96f8-4ae7-8a36-d1f5f72b2afd" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.786201] env[69188]: DEBUG networking_nsxv3.api.rpc [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('93e2a233-96f8-4ae7-8a36-d1f5f72b2afd',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.971627] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-86b3e666-35a3-418a-82c9-eb305c030ea1 taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.971846] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-86b3e666-35a3-418a-82c9-eb305c030ea1" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.971923] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-86b3e666-35a3-418a-82c9-eb305c030ea1" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.972177] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-86b3e666-35a3-418a-82c9-eb305c030ea1" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.972367] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.972499] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.972577] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.973231] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.973231] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.973231] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-86b3e666-35a3-418a-82c9-eb305c030ea1" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.973231] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-86b3e666-35a3-418a-82c9-eb305c030ea1 taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.973231] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-86b3e666-35a3-418a-82c9-eb305c030ea1" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.973231] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-86b3e666-35a3-418a-82c9-eb305c030ea1" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.973517] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-86b3e666-35a3-418a-82c9-eb305c030ea1" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.973517] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.974290] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.974290] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.974290] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.974290] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.974290] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-86b3e666-35a3-418a-82c9-eb305c030ea1" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.974290] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('86b3e666-35a3-418a-82c9-eb305c030ea1',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.289283] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.289283] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.289656] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.289850] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.290054] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.290256] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Segment Port 93e2a233-96f8-4ae7-8a36-d1f5f72b2afd not found, creating... [ 755.290571] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.290774] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.290930] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.291444] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.291444] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.291666] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.291755] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.291874] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.292098] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.292240] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.292378] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Resource: SegmentPort with ID: 93e2a233-96f8-4ae7-8a36-d1f5f72b2afd is going to be created. [ 755.311643] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.311847] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.312242] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.312242] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.312469] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.312694] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "port-93e2a233-96f8-4ae7-8a36-d1f5f72b2afd" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.476793] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 86b3e666-35a3-418a-82c9-eb305c030ea1: rpc.has_security_group_logging(os_id): False [ 755.495875] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.496048] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.496102] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.496312] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.496436] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.496623] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.496725] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.496789] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.496953] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.497042] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.497273] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.497360] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.497421] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.497576] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.497650] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.497837] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.497929] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.497994] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.498160] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.498319] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.498319] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 86b3e666-35a3-418a-82c9-eb305c030ea1 is going to be created. [ 755.560250] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.560439] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.560562] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.560810] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.561077] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.572574] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 86b3e666-35a3-418a-82c9-eb305c030ea1 in Status: IN_PROGRESS for 2s [ 755.696328] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 397559b2-3c5a-424d-b09d-43a25d2abba6 in Status: SUCCESS [ 755.696626] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-397559b2-3c5a-424d-b09d-43a25d2abba6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.199139] env[69188]: INFO networking_nsxv3.common.synchronization [req-0bff398a-6df1-4c7e-acf6-c9f053b4fc9e req-43b33480-ae4d-4a52-9a0d-8d16c367a8c8 service nova] Enqueued Resource ID: 7f98bc00-dbd3-411c-a67a-14369145489a with Priority: HIGHEST for action security_group_rules [ 756.199384] env[69188]: INFO networking_nsxv3.common.synchronization [req-0bff398a-6df1-4c7e-acf6-c9f053b4fc9e req-43b33480-ae4d-4a52-9a0d-8d16c367a8c8 service nova] Enqueued Resource ID: 7f98bc00-dbd3-411c-a67a-14369145489a with Priority: HIGHEST for action security_group_members [ 756.199535] env[69188]: INFO networking_nsxv3.common.synchronization [req-0bff398a-6df1-4c7e-acf6-c9f053b4fc9e req-43b33480-ae4d-4a52-9a0d-8d16c367a8c8 service nova] Enqueued Resource ID: 93e2a233-96f8-4ae7-8a36-d1f5f72b2afd with Priority: HIGHEST for action port [ 756.200105] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f98bc00-dbd3-411c-a67a-14369145489a with Priority: HIGHEST for action security_group_rules [ 756.200232] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f98bc00-dbd3-411c-a67a-14369145489a with Priority: HIGHEST for action security_group_members [ 756.200337] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 93e2a233-96f8-4ae7-8a36-d1f5f72b2afd with Priority: HIGHEST for action port [ 756.200694] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7f98bc00-dbd3-411c-a67a-14369145489a taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.200799] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7f98bc00-dbd3-411c-a67a-14369145489a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.200990] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-7f98bc00-dbd3-411c-a67a-14369145489a taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.201584] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7f98bc00-dbd3-411c-a67a-14369145489a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.201813] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-93e2a233-96f8-4ae7-8a36-d1f5f72b2afd taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.201941] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-93e2a233-96f8-4ae7-8a36-d1f5f72b2afd" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.202022] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-93e2a233-96f8-4ae7-8a36-d1f5f72b2afd" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.205550] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-93e2a233-96f8-4ae7-8a36-d1f5f72b2afd" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.205649] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('93e2a233-96f8-4ae7-8a36-d1f5f72b2afd',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.710028] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 93e2a233-96f8-4ae7-8a36-d1f5f72b2afd with status ACTIVE [ 756.710318] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.710318] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.710446] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.714025] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.714025] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.714025] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.714025] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.714025] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.714025] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.714025] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.714025] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.714025] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.714025] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.714025] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.714025] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.714025] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 93e2a233-96f8-4ae7-8a36-d1f5f72b2afd is going to be updated. [ 756.717413] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7f98bc00-dbd3-411c-a67a-14369145489a in Status: SUCCESS [ 756.717596] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7f98bc00-dbd3-411c-a67a-14369145489a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.717741] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7f98bc00-dbd3-411c-a67a-14369145489a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.717906] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7f98bc00-dbd3-411c-a67a-14369145489a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.718070] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.718201] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.718271] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.718412] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.718486] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.718562] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7f98bc00-dbd3-411c-a67a-14369145489a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.718655] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7f98bc00-dbd3-411c-a67a-14369145489a',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.719838] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7f98bc00-dbd3-411c-a67a-14369145489a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.720015] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7f98bc00-dbd3-411c-a67a-14369145489a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.720168] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.720259] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.720324] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.720457] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.720529] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.720612] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7f98bc00-dbd3-411c-a67a-14369145489a',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.744932] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.745082] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.745156] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.745380] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.745520] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.745668] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-93e2a233-96f8-4ae7-8a36-d1f5f72b2afd" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.222740] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-7f98bc00-dbd3-411c-a67a-14369145489a taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.222910] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7f98bc00-dbd3-411c-a67a-14369145489a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.226031] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7f98bc00-dbd3-411c-a67a-14369145489a',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.586624] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 86b3e666-35a3-418a-82c9-eb305c030ea1 in Status: SUCCESS [ 757.587202] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-86b3e666-35a3-418a-82c9-eb305c030ea1" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.729101] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7f98bc00-dbd3-411c-a67a-14369145489a',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.231189] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.231353] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.231425] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.231632] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.231729] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.231945] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7f98bc00-dbd3-411c-a67a-14369145489a is going to be updated. [ 758.256955] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.257111] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.257235] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.257459] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.257604] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.267029] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7f98bc00-dbd3-411c-a67a-14369145489a in Status: IN_PROGRESS for 2s [ 758.269381] env[69188]: INFO networking_nsxv3.common.synchronization [req-2e0aa8ef-b1d3-4317-a536-1795a570dea5 req-c07b2c7b-03f7-45b0-9067-da44c4825386 tempest-ServerDiskConfigTestJSON-1476779099 tempest-ServerDiskConfigTestJSON-1476779099-project-member] Enqueued Resource ID: 24a7b083-b432-46d6-94de-76adf6ce22b3 with Priority: HIGHEST for action security_group_members [ 758.269772] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 24a7b083-b432-46d6-94de-76adf6ce22b3 with Priority: HIGHEST for action security_group_members [ 758.270196] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-24a7b083-b432-46d6-94de-76adf6ce22b3 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.270332] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-24a7b083-b432-46d6-94de-76adf6ce22b3" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.270425] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-24a7b083-b432-46d6-94de-76adf6ce22b3" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.270593] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-24a7b083-b432-46d6-94de-76adf6ce22b3" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.270745] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.271081] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.271081] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.271081] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.271331] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.271331] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('24a7b083-b432-46d6-94de-76adf6ce22b3',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.773138] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.773505] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.773505] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.774141] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.774444] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.774834] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.774984] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.775082] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.775309] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.775375] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.775467] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 24a7b083-b432-46d6-94de-76adf6ce22b3 is going to be updated. [ 758.811376] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.811376] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.811376] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.811376] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.811376] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.822408] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 24a7b083-b432-46d6-94de-76adf6ce22b3 in Status: IN_PROGRESS for 2s [ 759.490080] env[69188]: INFO networking_nsxv3.common.synchronization [req-7cb34b74-5423-41b5-b715-02ed097efd1b req-a1df9464-a132-446a-b2a7-31edc30281da tempest-ServerActionsTestJSON-1027345226 tempest-ServerActionsTestJSON-1027345226-project-member] Enqueued Resource ID: 9482bec7-7d68-4fe1-8d77-d380c3f6dc7a with Priority: HIGHEST for action security_group_members [ 759.490080] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9482bec7-7d68-4fe1-8d77-d380c3f6dc7a with Priority: HIGHEST for action security_group_members [ 759.492777] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-9482bec7-7d68-4fe1-8d77-d380c3f6dc7a taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.492777] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9482bec7-7d68-4fe1-8d77-d380c3f6dc7a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.492777] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9482bec7-7d68-4fe1-8d77-d380c3f6dc7a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.492777] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9482bec7-7d68-4fe1-8d77-d380c3f6dc7a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.492777] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.492777] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.492777] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.492777] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.492777] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.492777] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9482bec7-7d68-4fe1-8d77-d380c3f6dc7a',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.858882] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock network-859 taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.859452] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "network-859" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.859689] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "network-859" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.859949] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "network-859" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.860919] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.861116] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.861574] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.863529] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.863739] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.863956] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 759.864092] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] NeedRegenerationException {{(pid=69188) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 759.864203] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] no value, waiting for create lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 759.864311] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] value creation lock acquired {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 759.864420] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 759.864524] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Calling creation function for not-yet-present value {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 759.864660] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 759.882147] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 759.882289] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69188) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 759.882427] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Released creation lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 759.882609] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "network-859" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.882922] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock port-2e046c9c-255e-4d82-ba0e-c835d85ea94e taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.883111] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "port-2e046c9c-255e-4d82-ba0e-c835d85ea94e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.883230] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "port-2e046c9c-255e-4d82-ba0e-c835d85ea94e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.883541] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "port-2e046c9c-255e-4d82-ba0e-c835d85ea94e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.883675] env[69188]: DEBUG networking_nsxv3.api.rpc [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2e046c9c-255e-4d82-ba0e-c835d85ea94e',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.995271] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.995271] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.995271] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.995271] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.995271] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.995271] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.995271] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.995271] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.995271] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.995271] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.995271] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9482bec7-7d68-4fe1-8d77-d380c3f6dc7a already deleted. [ 759.995271] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9482bec7-7d68-4fe1-8d77-d380c3f6dc7a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.028253] env[69188]: INFO networking_nsxv3.common.synchronization [None req-858c7d7e-e9c1-4274-9db2-8403274e9e8b None None] Enqueued Resource ID: 3be6f189-ff7b-44d1-a8a9-f465a1549ca0 with Priority: HIGHEST for action port [ 760.028253] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3be6f189-ff7b-44d1-a8a9-f465a1549ca0 with Priority: HIGHEST for action port [ 760.028253] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-3be6f189-ff7b-44d1-a8a9-f465a1549ca0 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.028253] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3be6f189-ff7b-44d1-a8a9-f465a1549ca0" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.028253] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3be6f189-ff7b-44d1-a8a9-f465a1549ca0" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.028253] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3be6f189-ff7b-44d1-a8a9-f465a1549ca0" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.028253] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3be6f189-ff7b-44d1-a8a9-f465a1549ca0',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.274751] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7f98bc00-dbd3-411c-a67a-14369145489a in Status: SUCCESS [ 760.274968] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7f98bc00-dbd3-411c-a67a-14369145489a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.275196] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7f98bc00-dbd3-411c-a67a-14369145489a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.275371] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7f98bc00-dbd3-411c-a67a-14369145489a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.275554] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.275667] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.275731] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.275883] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.275965] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.276137] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7f98bc00-dbd3-411c-a67a-14369145489a',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.386489] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.386717] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.386846] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.387141] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.387320] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.387482] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Segment Port 2e046c9c-255e-4d82-ba0e-c835d85ea94e not found, creating... [ 760.388039] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.388039] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.388039] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.388356] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.388514] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.389803] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.390035] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.390165] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.390379] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.390515] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.390652] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Resource: SegmentPort with ID: 2e046c9c-255e-4d82-ba0e-c835d85ea94e is going to be created. [ 760.409770] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.413348] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.413806] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.413806] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.415097] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.415097] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "port-2e046c9c-255e-4d82-ba0e-c835d85ea94e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.531031] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3be6f189-ff7b-44d1-a8a9-f465a1549ca0 [ 760.531031] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.531031] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.531031] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.531268] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.531268] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.531633] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3be6f189-ff7b-44d1-a8a9-f465a1549ca0 already deleted. [ 760.531633] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3be6f189-ff7b-44d1-a8a9-f465a1549ca0" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.780505] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7f98bc00-dbd3-411c-a67a-14369145489a',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.832188] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 24a7b083-b432-46d6-94de-76adf6ce22b3 in Status: SUCCESS [ 760.832188] env[69188]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 24a7b083-b432-46d6-94de-76adf6ce22b3 deletion is rescheduled due to dependency. [ 760.832188] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-24a7b083-b432-46d6-94de-76adf6ce22b3" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.911892] env[69188]: INFO networking_nsxv3.common.synchronization [None req-e145f4c1-8985-4058-8102-47f0d35adb5b tempest-ServerActionsTestOtherB-2131451762 tempest-ServerActionsTestOtherB-2131451762-project-member] Enqueued Resource ID: 867581e0-cbbd-4108-a823-0b7c53d47c3a with Priority: HIGHEST for action security_group_rules [ 760.912450] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 867581e0-cbbd-4108-a823-0b7c53d47c3a with Priority: HIGHEST for action security_group_rules [ 760.912744] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-867581e0-cbbd-4108-a823-0b7c53d47c3a taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.912865] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-867581e0-cbbd-4108-a823-0b7c53d47c3a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.912925] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-867581e0-cbbd-4108-a823-0b7c53d47c3a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.916578] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-867581e0-cbbd-4108-a823-0b7c53d47c3a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.916578] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('867581e0-cbbd-4108-a823-0b7c53d47c3a',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.053050] env[69188]: INFO networking_nsxv3.common.synchronization [None req-b0a3aa32-5a32-4228-ac4b-041550f569e3 tempest-ServerActionsTestOtherB-2131451762 tempest-ServerActionsTestOtherB-2131451762-project-member] Enqueued Resource ID: 867581e0-cbbd-4108-a823-0b7c53d47c3a with Priority: HIGHEST for action security_group_rules [ 761.053625] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 867581e0-cbbd-4108-a823-0b7c53d47c3a with Priority: HIGHEST for action security_group_rules [ 761.053947] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-867581e0-cbbd-4108-a823-0b7c53d47c3a taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.054107] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-867581e0-cbbd-4108-a823-0b7c53d47c3a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.154844] env[69188]: INFO networking_nsxv3.common.synchronization [req-7cb34b74-5423-41b5-b715-02ed097efd1b req-06d5c773-3c73-4fd9-860b-b07d9126bdef service nova] Enqueued Resource ID: 9482bec7-7d68-4fe1-8d77-d380c3f6dc7a with Priority: HIGHEST for action security_group_rules [ 761.155029] env[69188]: INFO networking_nsxv3.common.synchronization [req-7cb34b74-5423-41b5-b715-02ed097efd1b req-06d5c773-3c73-4fd9-860b-b07d9126bdef service nova] Enqueued Resource ID: 9482bec7-7d68-4fe1-8d77-d380c3f6dc7a with Priority: HIGHEST for action security_group_members [ 761.155165] env[69188]: INFO networking_nsxv3.common.synchronization [req-7cb34b74-5423-41b5-b715-02ed097efd1b req-06d5c773-3c73-4fd9-860b-b07d9126bdef service nova] Enqueued Resource ID: 2e046c9c-255e-4d82-ba0e-c835d85ea94e with Priority: HIGHEST for action port [ 761.155402] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9482bec7-7d68-4fe1-8d77-d380c3f6dc7a with Priority: HIGHEST for action security_group_rules [ 761.155521] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9482bec7-7d68-4fe1-8d77-d380c3f6dc7a with Priority: HIGHEST for action security_group_members [ 761.155611] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2e046c9c-255e-4d82-ba0e-c835d85ea94e with Priority: HIGHEST for action port [ 761.157919] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9482bec7-7d68-4fe1-8d77-d380c3f6dc7a taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.157919] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9482bec7-7d68-4fe1-8d77-d380c3f6dc7a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.157919] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9482bec7-7d68-4fe1-8d77-d380c3f6dc7a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.157919] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9482bec7-7d68-4fe1-8d77-d380c3f6dc7a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.157919] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9482bec7-7d68-4fe1-8d77-d380c3f6dc7a',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.163872] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-9482bec7-7d68-4fe1-8d77-d380c3f6dc7a taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.163872] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9482bec7-7d68-4fe1-8d77-d380c3f6dc7a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.163872] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9482bec7-7d68-4fe1-8d77-d380c3f6dc7a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.163872] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9482bec7-7d68-4fe1-8d77-d380c3f6dc7a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.163872] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.163872] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.163872] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.163872] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.163872] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.163872] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9482bec7-7d68-4fe1-8d77-d380c3f6dc7a',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.163872] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-2e046c9c-255e-4d82-ba0e-c835d85ea94e taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.163872] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2e046c9c-255e-4d82-ba0e-c835d85ea94e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.163872] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2e046c9c-255e-4d82-ba0e-c835d85ea94e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.163872] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2e046c9c-255e-4d82-ba0e-c835d85ea94e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.163872] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2e046c9c-255e-4d82-ba0e-c835d85ea94e',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.282466] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7f98bc00-dbd3-411c-a67a-14369145489a',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.437501] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.437772] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.437860] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.438061] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.441101] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.441101] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 867581e0-cbbd-4108-a823-0b7c53d47c3a already deleted. [ 761.441101] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-867581e0-cbbd-4108-a823-0b7c53d47c3a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.441101] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-867581e0-cbbd-4108-a823-0b7c53d47c3a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.441101] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-867581e0-cbbd-4108-a823-0b7c53d47c3a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.441101] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('867581e0-cbbd-4108-a823-0b7c53d47c3a',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.665556] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-9482bec7-7d68-4fe1-8d77-d380c3f6dc7a taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.665745] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9482bec7-7d68-4fe1-8d77-d380c3f6dc7a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.665975] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9482bec7-7d68-4fe1-8d77-d380c3f6dc7a',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.669197] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2e046c9c-255e-4d82-ba0e-c835d85ea94e with status ACTIVE [ 761.669446] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.669572] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.669641] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.669843] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.669933] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.670115] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.670210] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.670263] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.670414] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.670488] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.670662] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.670753] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.670813] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.670946] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.671051] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.671148] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2e046c9c-255e-4d82-ba0e-c835d85ea94e is going to be updated. [ 761.691539] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.691710] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.691845] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.691994] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.692172] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.692360] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2e046c9c-255e-4d82-ba0e-c835d85ea94e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.787074] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.787265] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.789237] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.789237] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.789237] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.789237] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7f98bc00-dbd3-411c-a67a-14369145489a is going to be updated. [ 761.826835] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.826994] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.827081] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.827386] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.827528] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.836231] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7f98bc00-dbd3-411c-a67a-14369145489a in Status: IN_PROGRESS for 2s [ 761.957704] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.957934] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.957934] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.958177] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.958350] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.958401] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 867581e0-cbbd-4108-a823-0b7c53d47c3a already deleted. [ 761.958450] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-867581e0-cbbd-4108-a823-0b7c53d47c3a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.173935] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9482bec7-7d68-4fe1-8d77-d380c3f6dc7a',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.580084] env[69188]: INFO networking_nsxv3.common.synchronization [None req-c765c1ee-5660-4091-958d-f6dc0673db5d None None] Enqueued Resource ID: deeb820c-9aaf-480e-90ff-9800f2d8de8d with Priority: HIGHEST for action port [ 762.580084] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: deeb820c-9aaf-480e-90ff-9800f2d8de8d with Priority: HIGHEST for action port [ 762.580401] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-deeb820c-9aaf-480e-90ff-9800f2d8de8d taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.580645] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-deeb820c-9aaf-480e-90ff-9800f2d8de8d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.580799] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-deeb820c-9aaf-480e-90ff-9800f2d8de8d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.581254] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-deeb820c-9aaf-480e-90ff-9800f2d8de8d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.582548] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('deeb820c-9aaf-480e-90ff-9800f2d8de8d',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.676504] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.676912] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.677539] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.677539] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.677777] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.678089] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9482bec7-7d68-4fe1-8d77-d380c3f6dc7a is going to be created. [ 762.700384] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.700534] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.701229] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.701229] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.701229] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.711562] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9482bec7-7d68-4fe1-8d77-d380c3f6dc7a in Status: UNINITIALIZED for 2s [ 763.083988] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port deeb820c-9aaf-480e-90ff-9800f2d8de8d [ 763.084269] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.084584] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.084665] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.084934] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.084995] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.085082] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:deeb820c-9aaf-480e-90ff-9800f2d8de8d already deleted. [ 763.085162] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-deeb820c-9aaf-480e-90ff-9800f2d8de8d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.846965] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7f98bc00-dbd3-411c-a67a-14369145489a in Status: SUCCESS [ 763.847345] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7f98bc00-dbd3-411c-a67a-14369145489a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.847610] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7f98bc00-dbd3-411c-a67a-14369145489a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.847748] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7f98bc00-dbd3-411c-a67a-14369145489a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.847958] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.848085] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.848147] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.848380] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.848477] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.848560] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7f98bc00-dbd3-411c-a67a-14369145489a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.848729] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-7f98bc00-dbd3-411c-a67a-14369145489a taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.848821] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7f98bc00-dbd3-411c-a67a-14369145489a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.848877] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7f98bc00-dbd3-411c-a67a-14369145489a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.849209] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7f98bc00-dbd3-411c-a67a-14369145489a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.849377] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.849877] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.849962] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.850518] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.850632] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.851354] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7f98bc00-dbd3-411c-a67a-14369145489a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.851467] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7f98bc00-dbd3-411c-a67a-14369145489a',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.996383] env[69188]: INFO networking_nsxv3.common.synchronization [req-c03c2066-0442-421c-ae57-56eed3d37827 req-1e8de438-4829-4f13-b025-59b98e5720f1 tempest-TenantUsagesTestJSON-744140899 tempest-TenantUsagesTestJSON-744140899-project-member] Enqueued Resource ID: 86b3e666-35a3-418a-82c9-eb305c030ea1 with Priority: HIGHEST for action security_group_members [ 763.997488] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 86b3e666-35a3-418a-82c9-eb305c030ea1 with Priority: HIGHEST for action security_group_members [ 763.997863] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-86b3e666-35a3-418a-82c9-eb305c030ea1 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.998021] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-86b3e666-35a3-418a-82c9-eb305c030ea1" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.998088] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-86b3e666-35a3-418a-82c9-eb305c030ea1" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.998344] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-86b3e666-35a3-418a-82c9-eb305c030ea1" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.998528] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.998633] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.998715] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.998863] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.998950] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.999077] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('86b3e666-35a3-418a-82c9-eb305c030ea1',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.356207] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7f98bc00-dbd3-411c-a67a-14369145489a: rpc.has_security_group_logging(os_id): False [ 764.374673] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.374816] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.374889] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.375735] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.375735] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.375735] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.375735] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.375735] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.375735] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.375735] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.376022] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.376066] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.376186] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.376361] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.376361] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.376534] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.376610] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.376658] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.378243] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.378243] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.378243] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7f98bc00-dbd3-411c-a67a-14369145489a is going to be created. [ 764.435342] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.436102] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.436102] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.436102] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.436102] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.447088] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7f98bc00-dbd3-411c-a67a-14369145489a in Status: IN_PROGRESS for 2s [ 764.503160] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.503375] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.503435] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.503616] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.503838] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.503931] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.504030] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.504089] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.504236] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.504313] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.504395] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 86b3e666-35a3-418a-82c9-eb305c030ea1 is going to be updated. [ 764.544578] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.544578] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.544700] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.544940] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.545069] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.553725] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 86b3e666-35a3-418a-82c9-eb305c030ea1 in Status: IN_PROGRESS for 2s [ 764.610301] env[69188]: INFO networking_nsxv3.common.synchronization [None req-856fe5a3-ba85-4caf-a23a-5002b1a891d6 tempest-MigrationsAdminTest-718349773 tempest-MigrationsAdminTest-718349773-project-member] Enqueued Resource ID: ab0bf85e-7a4e-4d95-891b-907c1ad68b0d with Priority: HIGHEST for action security_group_rules [ 764.610852] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab0bf85e-7a4e-4d95-891b-907c1ad68b0d with Priority: HIGHEST for action security_group_rules [ 764.611166] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ab0bf85e-7a4e-4d95-891b-907c1ad68b0d taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.611507] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ab0bf85e-7a4e-4d95-891b-907c1ad68b0d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.611507] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ab0bf85e-7a4e-4d95-891b-907c1ad68b0d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.611594] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ab0bf85e-7a4e-4d95-891b-907c1ad68b0d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.611662] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ab0bf85e-7a4e-4d95-891b-907c1ad68b0d',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.692067] env[69188]: INFO networking_nsxv3.common.synchronization [None req-4dde163e-4545-4807-875b-2dda729648d6 tempest-MigrationsAdminTest-718349773 tempest-MigrationsAdminTest-718349773-project-member] Enqueued Resource ID: ab0bf85e-7a4e-4d95-891b-907c1ad68b0d with Priority: HIGHEST for action security_group_rules [ 764.692067] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab0bf85e-7a4e-4d95-891b-907c1ad68b0d with Priority: HIGHEST for action security_group_rules [ 764.692067] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ab0bf85e-7a4e-4d95-891b-907c1ad68b0d taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.692067] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ab0bf85e-7a4e-4d95-891b-907c1ad68b0d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.736751] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9482bec7-7d68-4fe1-8d77-d380c3f6dc7a in Status: SUCCESS [ 764.736979] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9482bec7-7d68-4fe1-8d77-d380c3f6dc7a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.737151] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9482bec7-7d68-4fe1-8d77-d380c3f6dc7a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.737415] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9482bec7-7d68-4fe1-8d77-d380c3f6dc7a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.737605] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.737724] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.737789] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.737932] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.738025] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.738111] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9482bec7-7d68-4fe1-8d77-d380c3f6dc7a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.738201] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9482bec7-7d68-4fe1-8d77-d380c3f6dc7a',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.132647] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.132789] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.132861] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.133097] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.134216] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.134216] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ab0bf85e-7a4e-4d95-891b-907c1ad68b0d already deleted. [ 765.134216] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ab0bf85e-7a4e-4d95-891b-907c1ad68b0d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.134216] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ab0bf85e-7a4e-4d95-891b-907c1ad68b0d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.134216] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ab0bf85e-7a4e-4d95-891b-907c1ad68b0d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.134216] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ab0bf85e-7a4e-4d95-891b-907c1ad68b0d',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.240973] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9482bec7-7d68-4fe1-8d77-d380c3f6dc7a',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.654285] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.654653] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.654653] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.654835] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.654971] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.655158] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ab0bf85e-7a4e-4d95-891b-907c1ad68b0d already deleted. [ 765.655584] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ab0bf85e-7a4e-4d95-891b-907c1ad68b0d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.747091] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9482bec7-7d68-4fe1-8d77-d380c3f6dc7a: rpc.has_security_group_logging(os_id): False [ 765.765282] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.765420] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.765488] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.766018] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.766018] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.766018] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.766189] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.766189] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.766334] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.766409] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.767408] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9482bec7-7d68-4fe1-8d77-d380c3f6dc7a is going to be created. [ 765.824109] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.824298] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.824375] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.824914] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.824914] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.837544] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9482bec7-7d68-4fe1-8d77-d380c3f6dc7a in Status: IN_PROGRESS for 2s [ 766.459939] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7f98bc00-dbd3-411c-a67a-14369145489a in Status: SUCCESS [ 766.459939] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7f98bc00-dbd3-411c-a67a-14369145489a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.460524] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7f98bc00-dbd3-411c-a67a-14369145489a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.461079] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7f98bc00-dbd3-411c-a67a-14369145489a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.462761] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7f98bc00-dbd3-411c-a67a-14369145489a',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.565472] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 86b3e666-35a3-418a-82c9-eb305c030ea1 in Status: SUCCESS [ 766.565663] env[69188]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 86b3e666-35a3-418a-82c9-eb305c030ea1 deletion is rescheduled due to dependency. [ 766.565779] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-86b3e666-35a3-418a-82c9-eb305c030ea1" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.641763] env[69188]: INFO networking_nsxv3.common.synchronization [req-b4521dcf-d700-45d0-963b-5b8a0663b8f6 req-9417af7a-774c-49a6-a76d-036a5cee9ca0 tempest-ServerPasswordTestJSON-548197448 tempest-ServerPasswordTestJSON-548197448-project-member] Enqueued Resource ID: dbff1afa-14ec-4fad-8985-0fb6140d58bb with Priority: HIGHEST for action security_group_members [ 766.642537] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dbff1afa-14ec-4fad-8985-0fb6140d58bb with Priority: HIGHEST for action security_group_members [ 766.642629] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-dbff1afa-14ec-4fad-8985-0fb6140d58bb taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.642747] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dbff1afa-14ec-4fad-8985-0fb6140d58bb" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.642818] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dbff1afa-14ec-4fad-8985-0fb6140d58bb" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.644099] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dbff1afa-14ec-4fad-8985-0fb6140d58bb" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.644259] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.644908] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.644908] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.644908] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.644908] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.644908] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dbff1afa-14ec-4fad-8985-0fb6140d58bb',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.965192] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-7f98bc00-dbd3-411c-a67a-14369145489a taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.965564] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7f98bc00-dbd3-411c-a67a-14369145489a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.965564] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7f98bc00-dbd3-411c-a67a-14369145489a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.965765] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7f98bc00-dbd3-411c-a67a-14369145489a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.969266] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.969410] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.969479] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.971639] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.971639] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.971639] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7f98bc00-dbd3-411c-a67a-14369145489a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.971639] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7f98bc00-dbd3-411c-a67a-14369145489a',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.150179] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.150330] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.153020] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.153020] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.153020] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.153020] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.153020] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.153020] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.153020] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.153020] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.153020] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dbff1afa-14ec-4fad-8985-0fb6140d58bb already deleted. [ 767.153020] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dbff1afa-14ec-4fad-8985-0fb6140d58bb" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.189596] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock network-766 taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.190225] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "network-766" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.190225] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "network-766" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.190350] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "network-766" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.190642] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.190799] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.190914] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.191610] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.191777] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.192035] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 767.192160] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] NeedRegenerationException {{(pid=69188) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 767.192273] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] no value, waiting for create lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 767.192386] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] value creation lock acquired {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 767.192519] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 767.192627] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Calling creation function for not-yet-present value {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 767.192765] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 767.214031] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 767.214031] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69188) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 767.214031] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Released creation lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 767.214031] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "network-766" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.214031] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock port-9813b627-5305-48d5-ad01-3586025b03d8 taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.214031] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "port-9813b627-5305-48d5-ad01-3586025b03d8" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.214031] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "port-9813b627-5305-48d5-ad01-3586025b03d8" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.214031] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "port-9813b627-5305-48d5-ad01-3586025b03d8" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.214031] env[69188]: DEBUG networking_nsxv3.api.rpc [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9813b627-5305-48d5-ad01-3586025b03d8',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.475014] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-7f98bc00-dbd3-411c-a67a-14369145489a taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.475191] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7f98bc00-dbd3-411c-a67a-14369145489a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.475292] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7f98bc00-dbd3-411c-a67a-14369145489a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.475522] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7f98bc00-dbd3-411c-a67a-14369145489a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.475719] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.475843] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.475923] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.476103] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.476232] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.476283] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7f98bc00-dbd3-411c-a67a-14369145489a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.476419] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-7f98bc00-dbd3-411c-a67a-14369145489a taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.476515] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7f98bc00-dbd3-411c-a67a-14369145489a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.476576] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7f98bc00-dbd3-411c-a67a-14369145489a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.476717] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7f98bc00-dbd3-411c-a67a-14369145489a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.476850] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.476940] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.477008] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.477152] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.477260] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.477318] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7f98bc00-dbd3-411c-a67a-14369145489a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.477413] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7f98bc00-dbd3-411c-a67a-14369145489a',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.718515] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.718739] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.718870] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.719181] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.719356] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.719494] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Segment Port 9813b627-5305-48d5-ad01-3586025b03d8 not found, creating... [ 767.719751] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.719904] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.720033] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.720255] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.720395] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.720675] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.720854] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.721027] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.721266] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.721412] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.721547] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Resource: SegmentPort with ID: 9813b627-5305-48d5-ad01-3586025b03d8 is going to be created. [ 767.742970] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.743753] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.743753] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.743753] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.743948] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.744468] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "port-9813b627-5305-48d5-ad01-3586025b03d8" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.886150] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9482bec7-7d68-4fe1-8d77-d380c3f6dc7a in Status: SUCCESS [ 767.887222] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9482bec7-7d68-4fe1-8d77-d380c3f6dc7a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.979649] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7f98bc00-dbd3-411c-a67a-14369145489a: rpc.has_security_group_logging(os_id): False [ 768.000339] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.000339] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.000339] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.000339] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.000339] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.000339] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.000339] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.000339] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.000339] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.000339] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.000339] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.000339] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.000339] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.000339] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.000339] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.000943] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.000943] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.000943] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.000943] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.000943] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.000943] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7f98bc00-dbd3-411c-a67a-14369145489a is going to be updated. [ 768.067422] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.067422] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.067422] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.067621] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.067701] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.079786] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7f98bc00-dbd3-411c-a67a-14369145489a in Status: IN_PROGRESS for 2s [ 768.579040] env[69188]: INFO networking_nsxv3.common.synchronization [req-1ea51c3d-35a4-423a-86c1-541854d66709 req-d1787f25-686d-433a-bb7b-e3f4d50a2396 tempest-ServersWithSpecificFlavorTestJSON-1359499520 tempest-ServersWithSpecificFlavorTestJSON-1359499520-project-member] Enqueued Resource ID: ec45d27b-caa2-4488-8317-d6595de404b8 with Priority: HIGHEST for action security_group_members [ 768.583031] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ec45d27b-caa2-4488-8317-d6595de404b8 with Priority: HIGHEST for action security_group_members [ 768.583031] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-ec45d27b-caa2-4488-8317-d6595de404b8 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.583031] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ec45d27b-caa2-4488-8317-d6595de404b8" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.583031] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ec45d27b-caa2-4488-8317-d6595de404b8" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.583031] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ec45d27b-caa2-4488-8317-d6595de404b8" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.583031] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.583031] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.583031] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.583031] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.583031] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.583031] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ec45d27b-caa2-4488-8317-d6595de404b8',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.737451] env[69188]: INFO networking_nsxv3.common.synchronization [req-b4521dcf-d700-45d0-963b-5b8a0663b8f6 req-84f5a109-4964-4003-bc24-47ba84edc430 service nova] Enqueued Resource ID: dbff1afa-14ec-4fad-8985-0fb6140d58bb with Priority: HIGHEST for action security_group_rules [ 768.737451] env[69188]: INFO networking_nsxv3.common.synchronization [req-b4521dcf-d700-45d0-963b-5b8a0663b8f6 req-84f5a109-4964-4003-bc24-47ba84edc430 service nova] Enqueued Resource ID: dbff1afa-14ec-4fad-8985-0fb6140d58bb with Priority: HIGHEST for action security_group_members [ 768.737451] env[69188]: INFO networking_nsxv3.common.synchronization [req-b4521dcf-d700-45d0-963b-5b8a0663b8f6 req-84f5a109-4964-4003-bc24-47ba84edc430 service nova] Enqueued Resource ID: 9813b627-5305-48d5-ad01-3586025b03d8 with Priority: HIGHEST for action port [ 768.737451] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dbff1afa-14ec-4fad-8985-0fb6140d58bb with Priority: HIGHEST for action security_group_rules [ 768.737451] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dbff1afa-14ec-4fad-8985-0fb6140d58bb with Priority: HIGHEST for action security_group_members [ 768.737451] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9813b627-5305-48d5-ad01-3586025b03d8 with Priority: HIGHEST for action port [ 768.737451] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dbff1afa-14ec-4fad-8985-0fb6140d58bb taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.737451] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dbff1afa-14ec-4fad-8985-0fb6140d58bb" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.737451] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dbff1afa-14ec-4fad-8985-0fb6140d58bb" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.737451] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dbff1afa-14ec-4fad-8985-0fb6140d58bb" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.737451] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dbff1afa-14ec-4fad-8985-0fb6140d58bb',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.737451] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-dbff1afa-14ec-4fad-8985-0fb6140d58bb taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.737451] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dbff1afa-14ec-4fad-8985-0fb6140d58bb" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.737451] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dbff1afa-14ec-4fad-8985-0fb6140d58bb" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.737451] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dbff1afa-14ec-4fad-8985-0fb6140d58bb" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.737451] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.737451] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.737451] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.737451] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.737451] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.738271] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dbff1afa-14ec-4fad-8985-0fb6140d58bb',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.738271] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-9813b627-5305-48d5-ad01-3586025b03d8 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.738271] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9813b627-5305-48d5-ad01-3586025b03d8" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.738271] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9813b627-5305-48d5-ad01-3586025b03d8" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.738271] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9813b627-5305-48d5-ad01-3586025b03d8" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.738271] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9813b627-5305-48d5-ad01-3586025b03d8',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.085023] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.085023] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.085023] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.085023] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.085023] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.085023] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.085569] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.085569] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.085569] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.085569] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.085569] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ec45d27b-caa2-4488-8317-d6595de404b8 is going to be updated. [ 769.118052] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.118279] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.118338] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.118519] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.118662] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.131999] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ec45d27b-caa2-4488-8317-d6595de404b8 in Status: IN_PROGRESS for 2s [ 769.241485] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-dbff1afa-14ec-4fad-8985-0fb6140d58bb taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.241664] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dbff1afa-14ec-4fad-8985-0fb6140d58bb" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.241860] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dbff1afa-14ec-4fad-8985-0fb6140d58bb',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.243084] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9813b627-5305-48d5-ad01-3586025b03d8 with status ACTIVE [ 769.243084] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.243084] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.243282] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.243420] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.243420] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.244428] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.244428] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.244428] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.244428] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.244428] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.244428] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.244428] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.244428] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.244731] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.244731] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.246086] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9813b627-5305-48d5-ad01-3586025b03d8 is going to be updated. [ 769.266261] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.266389] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.266547] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.266669] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.266799] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.266965] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9813b627-5305-48d5-ad01-3586025b03d8" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.748046] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dbff1afa-14ec-4fad-8985-0fb6140d58bb',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.914139] env[69188]: INFO networking_nsxv3.common.synchronization [req-7eec45d5-77df-4c50-abf3-582afcf2128b req-74008279-801a-4f63-96ec-2692f7d282ed tempest-MultipleCreateTestJSON-27366217 tempest-MultipleCreateTestJSON-27366217-project-member] Enqueued Resource ID: 7f98bc00-dbd3-411c-a67a-14369145489a with Priority: HIGHEST for action security_group_members [ 769.914139] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f98bc00-dbd3-411c-a67a-14369145489a with Priority: HIGHEST for action security_group_members [ 769.914344] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-7f98bc00-dbd3-411c-a67a-14369145489a taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.914515] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7f98bc00-dbd3-411c-a67a-14369145489a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.914577] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7f98bc00-dbd3-411c-a67a-14369145489a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.914733] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7f98bc00-dbd3-411c-a67a-14369145489a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.914884] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.915031] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.918683] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.918683] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.918683] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.918683] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7f98bc00-dbd3-411c-a67a-14369145489a',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.092248] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7f98bc00-dbd3-411c-a67a-14369145489a in Status: SUCCESS [ 770.092508] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7f98bc00-dbd3-411c-a67a-14369145489a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.104437] env[69188]: INFO networking_nsxv3.common.synchronization [req-89001038-bd92-427d-9a6a-5c386f220998 req-6e8c61ea-3061-4663-8f59-a717c0eedeb5 tempest-MultipleCreateTestJSON-27366217 tempest-MultipleCreateTestJSON-27366217-project-member] Enqueued Resource ID: 7f98bc00-dbd3-411c-a67a-14369145489a with Priority: HIGHEST for action security_group_members [ 770.104951] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f98bc00-dbd3-411c-a67a-14369145489a with Priority: HIGHEST for action security_group_members [ 770.105276] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-7f98bc00-dbd3-411c-a67a-14369145489a taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.105373] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7f98bc00-dbd3-411c-a67a-14369145489a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.253022] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.253022] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.253022] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.253022] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.253022] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.253022] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dbff1afa-14ec-4fad-8985-0fb6140d58bb is going to be created. [ 770.277402] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.277402] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.277402] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.277402] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.277402] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.285489] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dbff1afa-14ec-4fad-8985-0fb6140d58bb in Status: UNINITIALIZED for 2s [ 770.420313] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7f98bc00-dbd3-411c-a67a-14369145489a',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.922732] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7f98bc00-dbd3-411c-a67a-14369145489a',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.141526] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ec45d27b-caa2-4488-8317-d6595de404b8 in Status: SUCCESS [ 771.142400] env[69188]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ec45d27b-caa2-4488-8317-d6595de404b8 deletion is rescheduled due to dependency. [ 771.142400] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ec45d27b-caa2-4488-8317-d6595de404b8" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.302178] env[69188]: INFO networking_nsxv3.common.synchronization [req-5fc0aa5f-94fc-4fd3-8560-ba1fb2509d2e req-0b23d545-2a25-47fc-ae54-4815f45f2975 tempest-ListServerFiltersTestJSON-1426102960 tempest-ListServerFiltersTestJSON-1426102960-project-member] Enqueued Resource ID: e2f14ed1-21b8-4d1e-b6bc-559e167b9967 with Priority: HIGHEST for action security_group_members [ 771.302744] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2f14ed1-21b8-4d1e-b6bc-559e167b9967 with Priority: HIGHEST for action security_group_members [ 771.303048] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2f14ed1-21b8-4d1e-b6bc-559e167b9967 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.303168] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2f14ed1-21b8-4d1e-b6bc-559e167b9967" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.304942] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2f14ed1-21b8-4d1e-b6bc-559e167b9967" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.305184] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2f14ed1-21b8-4d1e-b6bc-559e167b9967" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.305365] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.305464] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.305512] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.305656] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.306772] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.306772] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e2f14ed1-21b8-4d1e-b6bc-559e167b9967',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.426619] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.426797] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.426884] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.427082] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.427172] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.427648] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7f98bc00-dbd3-411c-a67a-14369145489a is going to be updated. [ 771.452889] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.453468] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.453468] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.453468] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.453468] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.461123] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7f98bc00-dbd3-411c-a67a-14369145489a in Status: IN_PROGRESS for 2s [ 771.812286] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e2f14ed1-21b8-4d1e-b6bc-559e167b9967',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.000983] env[69188]: INFO networking_nsxv3.common.synchronization [req-78f6e8d7-9b2c-421b-b38a-770475b69f18 req-0f0c22fa-be1e-4a3b-933b-81dabb2ae461 tempest-InstanceActionsV221TestJSON-634240840 tempest-InstanceActionsV221TestJSON-634240840-project-member] Enqueued Resource ID: eb8c8265-ddd7-41a1-a435-066f89c523e5 with Priority: HIGHEST for action security_group_members [ 772.001497] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eb8c8265-ddd7-41a1-a435-066f89c523e5 with Priority: HIGHEST for action security_group_members [ 772.001799] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-eb8c8265-ddd7-41a1-a435-066f89c523e5 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.001912] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eb8c8265-ddd7-41a1-a435-066f89c523e5" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.001981] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eb8c8265-ddd7-41a1-a435-066f89c523e5" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.003665] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eb8c8265-ddd7-41a1-a435-066f89c523e5" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.003665] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.003665] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.003665] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.004811] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.004811] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.004811] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('eb8c8265-ddd7-41a1-a435-066f89c523e5',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.294787] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dbff1afa-14ec-4fad-8985-0fb6140d58bb in Status: SUCCESS [ 772.295083] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dbff1afa-14ec-4fad-8985-0fb6140d58bb" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.296289] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dbff1afa-14ec-4fad-8985-0fb6140d58bb" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.296504] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dbff1afa-14ec-4fad-8985-0fb6140d58bb" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.296697] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.296821] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.296904] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.297084] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.297170] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.297252] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dbff1afa-14ec-4fad-8985-0fb6140d58bb" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.297361] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('dbff1afa-14ec-4fad-8985-0fb6140d58bb',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.317960] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e2f14ed1-21b8-4d1e-b6bc-559e167b9967',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.421278] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock network-849 taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.421498] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "network-849" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.421619] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "network-849" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.421951] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "network-849" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.422223] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.422479] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.422523] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.422701] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.422841] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.423051] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 772.423158] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] NeedRegenerationException {{(pid=69188) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 772.423262] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] no value, waiting for create lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 772.423364] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] value creation lock acquired {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 772.423489] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 772.423610] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Calling creation function for not-yet-present value {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 772.423740] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 772.443516] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 772.443580] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69188) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 772.443750] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Released creation lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 772.443991] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "network-849" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.444333] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock port-8db43c37-9ffc-45a5-885b-8569de6f64e3 taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.444511] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "port-8db43c37-9ffc-45a5-885b-8569de6f64e3" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.444629] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "port-8db43c37-9ffc-45a5-885b-8569de6f64e3" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.444955] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "port-8db43c37-9ffc-45a5-885b-8569de6f64e3" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.445110] env[69188]: DEBUG networking_nsxv3.api.rpc [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8db43c37-9ffc-45a5-885b-8569de6f64e3',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.506744] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.507430] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.507430] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.507430] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.507430] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.507611] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.507678] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.507678] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.507825] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.507897] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.507976] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eb8c8265-ddd7-41a1-a435-066f89c523e5 already deleted. [ 772.508063] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eb8c8265-ddd7-41a1-a435-066f89c523e5" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.800114] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-dbff1afa-14ec-4fad-8985-0fb6140d58bb taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.800313] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dbff1afa-14ec-4fad-8985-0fb6140d58bb" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.800394] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dbff1afa-14ec-4fad-8985-0fb6140d58bb" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.800581] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dbff1afa-14ec-4fad-8985-0fb6140d58bb" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.800752] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.800854] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.800907] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.801073] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.801165] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.801252] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dbff1afa-14ec-4fad-8985-0fb6140d58bb" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.801396] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-dbff1afa-14ec-4fad-8985-0fb6140d58bb taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.801489] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dbff1afa-14ec-4fad-8985-0fb6140d58bb" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.801607] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dbff1afa-14ec-4fad-8985-0fb6140d58bb" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.801698] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dbff1afa-14ec-4fad-8985-0fb6140d58bb" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.801912] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.802042] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.802121] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.802273] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.802352] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.802554] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dbff1afa-14ec-4fad-8985-0fb6140d58bb" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.802554] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('dbff1afa-14ec-4fad-8985-0fb6140d58bb',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.818997] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.819175] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.819249] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.819975] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.819975] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.819975] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e2f14ed1-21b8-4d1e-b6bc-559e167b9967 is going to be updated. [ 772.848795] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.848795] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.848936] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.849210] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.849311] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.858336] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e2f14ed1-21b8-4d1e-b6bc-559e167b9967 in Status: IN_PROGRESS for 2s [ 772.948474] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.948474] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.948474] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.948778] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.948956] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.949136] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Segment Port 8db43c37-9ffc-45a5-885b-8569de6f64e3 not found, creating... [ 772.949397] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.949685] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.949753] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.949984] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.950146] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.950446] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.950610] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.950729] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.950961] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.951107] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.951247] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Resource: SegmentPort with ID: 8db43c37-9ffc-45a5-885b-8569de6f64e3 is going to be created. [ 772.973152] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.973401] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.973524] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.973819] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.974072] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.974308] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "port-8db43c37-9ffc-45a5-885b-8569de6f64e3" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.304536] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for dbff1afa-14ec-4fad-8985-0fb6140d58bb: rpc.has_security_group_logging(os_id): False [ 773.321820] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.321975] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.322495] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.322495] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.322495] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.322661] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.322661] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.322774] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.322844] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.322922] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.323105] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.323217] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.323271] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.323395] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.323470] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.323652] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.323736] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.323795] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.323933] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.324018] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.324104] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dbff1afa-14ec-4fad-8985-0fb6140d58bb is going to be created. [ 773.382097] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.382097] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.382097] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.382097] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.382315] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.393985] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dbff1afa-14ec-4fad-8985-0fb6140d58bb in Status: IN_PROGRESS for 2s [ 773.473903] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7f98bc00-dbd3-411c-a67a-14369145489a in Status: SUCCESS [ 773.474442] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7f98bc00-dbd3-411c-a67a-14369145489a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.474773] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7f98bc00-dbd3-411c-a67a-14369145489a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.475117] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7f98bc00-dbd3-411c-a67a-14369145489a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.476573] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.476573] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.476573] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.476573] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.476573] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.476573] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7f98bc00-dbd3-411c-a67a-14369145489a',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.699154] env[69188]: INFO networking_nsxv3.common.synchronization [req-f2fd4450-b4ae-491d-a577-76ce99239201 req-087a187f-9977-4034-930a-bf63b07705a5 tempest-DeleteServersTestJSON-857706435 tempest-DeleteServersTestJSON-857706435-project-member] Enqueued Resource ID: 397559b2-3c5a-424d-b09d-43a25d2abba6 with Priority: HIGHEST for action security_group_members [ 773.699462] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 397559b2-3c5a-424d-b09d-43a25d2abba6 with Priority: HIGHEST for action security_group_members [ 773.699824] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-397559b2-3c5a-424d-b09d-43a25d2abba6 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.699980] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-397559b2-3c5a-424d-b09d-43a25d2abba6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.700083] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-397559b2-3c5a-424d-b09d-43a25d2abba6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.701420] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-397559b2-3c5a-424d-b09d-43a25d2abba6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.701420] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.701420] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.701420] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.701420] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.701420] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.701420] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('397559b2-3c5a-424d-b09d-43a25d2abba6',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.836120] env[69188]: INFO networking_nsxv3.common.synchronization [req-78f6e8d7-9b2c-421b-b38a-770475b69f18 req-1af93fec-9dae-4b73-ad67-8982575075a7 service nova] Enqueued Resource ID: eb8c8265-ddd7-41a1-a435-066f89c523e5 with Priority: HIGHEST for action security_group_rules [ 773.836120] env[69188]: INFO networking_nsxv3.common.synchronization [req-78f6e8d7-9b2c-421b-b38a-770475b69f18 req-1af93fec-9dae-4b73-ad67-8982575075a7 service nova] Enqueued Resource ID: eb8c8265-ddd7-41a1-a435-066f89c523e5 with Priority: HIGHEST for action security_group_members [ 773.836120] env[69188]: INFO networking_nsxv3.common.synchronization [req-78f6e8d7-9b2c-421b-b38a-770475b69f18 req-1af93fec-9dae-4b73-ad67-8982575075a7 service nova] Enqueued Resource ID: 8db43c37-9ffc-45a5-885b-8569de6f64e3 with Priority: HIGHEST for action port [ 773.836120] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eb8c8265-ddd7-41a1-a435-066f89c523e5 with Priority: HIGHEST for action security_group_rules [ 773.836120] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eb8c8265-ddd7-41a1-a435-066f89c523e5 with Priority: HIGHEST for action security_group_members [ 773.836120] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8db43c37-9ffc-45a5-885b-8569de6f64e3 with Priority: HIGHEST for action port [ 773.836120] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-eb8c8265-ddd7-41a1-a435-066f89c523e5 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.836120] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-eb8c8265-ddd7-41a1-a435-066f89c523e5" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.837172] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-eb8c8265-ddd7-41a1-a435-066f89c523e5" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.837723] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-eb8c8265-ddd7-41a1-a435-066f89c523e5" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.837993] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('eb8c8265-ddd7-41a1-a435-066f89c523e5',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.840535] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-eb8c8265-ddd7-41a1-a435-066f89c523e5 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.840800] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eb8c8265-ddd7-41a1-a435-066f89c523e5" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.841756] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eb8c8265-ddd7-41a1-a435-066f89c523e5" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.841756] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eb8c8265-ddd7-41a1-a435-066f89c523e5" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.841960] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.842119] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.842208] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.842562] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.842562] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.842562] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('eb8c8265-ddd7-41a1-a435-066f89c523e5',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.843387] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-8db43c37-9ffc-45a5-885b-8569de6f64e3 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.843573] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8db43c37-9ffc-45a5-885b-8569de6f64e3" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.843680] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8db43c37-9ffc-45a5-885b-8569de6f64e3" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.843843] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8db43c37-9ffc-45a5-885b-8569de6f64e3" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.843979] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8db43c37-9ffc-45a5-885b-8569de6f64e3',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.979451] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.979602] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.979697] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.979966] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.980991] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.980991] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.980991] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.980991] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.980991] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.980991] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.980991] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7f98bc00-dbd3-411c-a67a-14369145489a is going to be updated. [ 774.007158] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.007370] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.007460] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.007661] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.007804] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.015772] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7f98bc00-dbd3-411c-a67a-14369145489a in Status: IN_PROGRESS for 2s [ 774.205906] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.206094] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.206163] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.206379] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.206477] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.206676] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.206811] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.206876] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.207047] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.207125] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.207211] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 397559b2-3c5a-424d-b09d-43a25d2abba6 is going to be updated. [ 774.248859] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.248859] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.248859] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.248997] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.249153] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.256957] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 397559b2-3c5a-424d-b09d-43a25d2abba6 in Status: IN_PROGRESS for 2s [ 774.346038] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('eb8c8265-ddd7-41a1-a435-066f89c523e5',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.346973] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-eb8c8265-ddd7-41a1-a435-066f89c523e5 taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.347086] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eb8c8265-ddd7-41a1-a435-066f89c523e5" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.348503] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8db43c37-9ffc-45a5-885b-8569de6f64e3 with status ACTIVE [ 774.348673] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.348784] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.348853] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.349068] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.349163] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.349331] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.349432] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.349487] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.349639] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.349716] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.349894] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.349987] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.350053] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.350193] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.350270] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.350353] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8db43c37-9ffc-45a5-885b-8569de6f64e3 is going to be updated. [ 774.370177] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.370336] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.370421] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.370597] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.370731] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.370888] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8db43c37-9ffc-45a5-885b-8569de6f64e3" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.848670] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('eb8c8265-ddd7-41a1-a435-066f89c523e5',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.868362] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e2f14ed1-21b8-4d1e-b6bc-559e167b9967 in Status: SUCCESS [ 774.868546] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2f14ed1-21b8-4d1e-b6bc-559e167b9967" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.351156] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.351451] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.351451] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.351653] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.351777] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.351901] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eb8c8265-ddd7-41a1-a435-066f89c523e5 is going to be created. [ 775.373393] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.373550] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.373726] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.373954] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.374165] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.382665] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eb8c8265-ddd7-41a1-a435-066f89c523e5 in Status: UNINITIALIZED for 2s [ 775.404068] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dbff1afa-14ec-4fad-8985-0fb6140d58bb in Status: SUCCESS [ 775.404312] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dbff1afa-14ec-4fad-8985-0fb6140d58bb" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.024679] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7f98bc00-dbd3-411c-a67a-14369145489a in Status: SUCCESS [ 776.024863] env[69188]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7f98bc00-dbd3-411c-a67a-14369145489a deletion is rescheduled due to dependency. [ 776.024976] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7f98bc00-dbd3-411c-a67a-14369145489a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.266315] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 397559b2-3c5a-424d-b09d-43a25d2abba6 in Status: SUCCESS [ 776.266477] env[69188]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 397559b2-3c5a-424d-b09d-43a25d2abba6 deletion is rescheduled due to dependency. [ 776.266556] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-397559b2-3c5a-424d-b09d-43a25d2abba6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.961752] env[69188]: INFO networking_nsxv3.common.synchronization [req-67495138-4ee7-47b7-a896-6226c60ae3b5 req-cd7de954-7233-449a-8734-39a9a9f3f2cc tempest-FloatingIPsAssociationTestJSON-209902533 tempest-FloatingIPsAssociationTestJSON-209902533-project-member] Enqueued Resource ID: 53b2b927-2e3d-4111-b25a-7b34ab9fa28d with Priority: HIGHEST for action security_group_members [ 776.962296] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 53b2b927-2e3d-4111-b25a-7b34ab9fa28d with Priority: HIGHEST for action security_group_members [ 776.962598] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-53b2b927-2e3d-4111-b25a-7b34ab9fa28d taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.962720] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-53b2b927-2e3d-4111-b25a-7b34ab9fa28d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.964500] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-53b2b927-2e3d-4111-b25a-7b34ab9fa28d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.964752] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-53b2b927-2e3d-4111-b25a-7b34ab9fa28d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.964951] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.965103] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.965194] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.965400] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.965524] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.965648] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('53b2b927-2e3d-4111-b25a-7b34ab9fa28d',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.392674] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eb8c8265-ddd7-41a1-a435-066f89c523e5 in Status: SUCCESS [ 777.392841] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eb8c8265-ddd7-41a1-a435-066f89c523e5" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.392896] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eb8c8265-ddd7-41a1-a435-066f89c523e5" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.393103] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eb8c8265-ddd7-41a1-a435-066f89c523e5" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.393298] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.393407] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.393474] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.393619] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.393694] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.393811] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eb8c8265-ddd7-41a1-a435-066f89c523e5" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.394661] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('eb8c8265-ddd7-41a1-a435-066f89c523e5',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.468041] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.469102] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.469558] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.469558] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.469675] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.469832] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.469989] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.470054] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.470574] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.470574] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.470574] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 53b2b927-2e3d-4111-b25a-7b34ab9fa28d is going to be updated. [ 777.505257] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.505417] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.505494] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.505696] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.505836] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.514610] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 53b2b927-2e3d-4111-b25a-7b34ab9fa28d in Status: IN_PROGRESS for 2s [ 777.896162] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-eb8c8265-ddd7-41a1-a435-066f89c523e5 taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.896372] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eb8c8265-ddd7-41a1-a435-066f89c523e5" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.896502] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eb8c8265-ddd7-41a1-a435-066f89c523e5" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.896758] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eb8c8265-ddd7-41a1-a435-066f89c523e5" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.896966] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.897137] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.897179] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.897379] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.897458] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.897590] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eb8c8265-ddd7-41a1-a435-066f89c523e5" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.897764] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-eb8c8265-ddd7-41a1-a435-066f89c523e5 taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.897861] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eb8c8265-ddd7-41a1-a435-066f89c523e5" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.897924] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eb8c8265-ddd7-41a1-a435-066f89c523e5" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.898086] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eb8c8265-ddd7-41a1-a435-066f89c523e5" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.898232] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.898325] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.898400] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.898598] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.898699] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.898782] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eb8c8265-ddd7-41a1-a435-066f89c523e5" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.898872] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('eb8c8265-ddd7-41a1-a435-066f89c523e5',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.402321] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for eb8c8265-ddd7-41a1-a435-066f89c523e5: rpc.has_security_group_logging(os_id): False [ 778.424202] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.424366] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.424437] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.424649] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.424737] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.425183] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.425300] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.425433] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.425548] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.425626] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.425817] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.425907] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.425963] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.426109] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.426180] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.426352] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.426461] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.426521] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.426619] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.426688] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.428073] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: eb8c8265-ddd7-41a1-a435-066f89c523e5 is going to be created. [ 778.479949] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.480098] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.480173] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.480457] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.480665] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.490972] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: eb8c8265-ddd7-41a1-a435-066f89c523e5 in Status: IN_PROGRESS for 2s [ 779.525831] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 53b2b927-2e3d-4111-b25a-7b34ab9fa28d in Status: SUCCESS [ 779.526135] env[69188]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 53b2b927-2e3d-4111-b25a-7b34ab9fa28d deletion is rescheduled due to dependency. [ 779.526135] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-53b2b927-2e3d-4111-b25a-7b34ab9fa28d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.503261] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: eb8c8265-ddd7-41a1-a435-066f89c523e5 in Status: SUCCESS [ 780.503622] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-eb8c8265-ddd7-41a1-a435-066f89c523e5" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.963086] env[69188]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 781.963346] env[69188]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 782.286530] env[69188]: INFO networking_nsxv3.common.synchronization [req-7522fd72-97d5-4062-b258-9b9bfabec2ad req-0a83ed1c-9286-44aa-8b3d-220d3a494a6b tempest-ServerPasswordTestJSON-548197448 tempest-ServerPasswordTestJSON-548197448-project-member] Enqueued Resource ID: dbff1afa-14ec-4fad-8985-0fb6140d58bb with Priority: HIGHEST for action security_group_members [ 782.287015] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dbff1afa-14ec-4fad-8985-0fb6140d58bb with Priority: HIGHEST for action security_group_members [ 782.287446] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-dbff1afa-14ec-4fad-8985-0fb6140d58bb taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.287576] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dbff1afa-14ec-4fad-8985-0fb6140d58bb" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.287576] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dbff1afa-14ec-4fad-8985-0fb6140d58bb" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.287733] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dbff1afa-14ec-4fad-8985-0fb6140d58bb" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.287975] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.287975] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.289270] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.289270] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.289270] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.289270] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dbff1afa-14ec-4fad-8985-0fb6140d58bb',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.387128] env[69188]: INFO networking_nsxv3.common.synchronization [req-bac39eb1-a0c3-4276-84c2-1108295ec7cb req-8263a1b9-09f5-4b2f-9bdf-b340555b9b1b tempest-VolumesAssistedSnapshotsTest-1534843512 tempest-VolumesAssistedSnapshotsTest-1534843512-project-member] Enqueued Resource ID: 3cd8cf7d-5793-4464-821e-78828cb956a9 with Priority: HIGHEST for action security_group_members [ 782.387641] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3cd8cf7d-5793-4464-821e-78828cb956a9 with Priority: HIGHEST for action security_group_members [ 782.387945] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-3cd8cf7d-5793-4464-821e-78828cb956a9 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.388077] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3cd8cf7d-5793-4464-821e-78828cb956a9" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.388193] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3cd8cf7d-5793-4464-821e-78828cb956a9" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.388329] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3cd8cf7d-5793-4464-821e-78828cb956a9" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.388973] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.388973] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.388973] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.388973] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.388973] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.388973] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3cd8cf7d-5793-4464-821e-78828cb956a9',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.794450] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.794606] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.794664] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.794877] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.794971] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.795182] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.795320] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.795376] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.795482] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.795560] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.795644] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dbff1afa-14ec-4fad-8985-0fb6140d58bb is going to be updated. [ 782.823386] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.823581] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.823717] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.823868] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.824016] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.832304] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dbff1afa-14ec-4fad-8985-0fb6140d58bb in Status: IN_PROGRESS for 2s [ 782.890900] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.891063] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.891137] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.891430] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.891521] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.892646] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.892646] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.892646] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.892646] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.892646] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.892646] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3cd8cf7d-5793-4464-821e-78828cb956a9 is going to be updated. [ 782.920199] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.920199] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.920199] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.920199] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.920199] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.926614] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3cd8cf7d-5793-4464-821e-78828cb956a9 in Status: IN_PROGRESS for 2s [ 784.840956] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dbff1afa-14ec-4fad-8985-0fb6140d58bb in Status: SUCCESS [ 784.841239] env[69188]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dbff1afa-14ec-4fad-8985-0fb6140d58bb deletion is rescheduled due to dependency. [ 784.841284] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dbff1afa-14ec-4fad-8985-0fb6140d58bb" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.935873] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3cd8cf7d-5793-4464-821e-78828cb956a9 in Status: SUCCESS [ 784.936572] env[69188]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3cd8cf7d-5793-4464-821e-78828cb956a9 deletion is rescheduled due to dependency. [ 784.936572] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3cd8cf7d-5793-4464-821e-78828cb956a9" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.129770] env[69188]: INFO networking_nsxv3.common.synchronization [req-4921ad76-b289-4451-aebe-e773c2fafa58 req-d642abaf-b04b-4a6a-9ccf-5355f197d9dd tempest-InstanceActionsV221TestJSON-634240840 tempest-InstanceActionsV221TestJSON-634240840-project-member] Enqueued Resource ID: eb8c8265-ddd7-41a1-a435-066f89c523e5 with Priority: HIGHEST for action security_group_members [ 785.130343] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eb8c8265-ddd7-41a1-a435-066f89c523e5 with Priority: HIGHEST for action security_group_members [ 785.130652] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-eb8c8265-ddd7-41a1-a435-066f89c523e5 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.130779] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eb8c8265-ddd7-41a1-a435-066f89c523e5" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.130849] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eb8c8265-ddd7-41a1-a435-066f89c523e5" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.131058] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eb8c8265-ddd7-41a1-a435-066f89c523e5" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.131208] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.131302] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.131364] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.131504] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.131589] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.131680] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('eb8c8265-ddd7-41a1-a435-066f89c523e5',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.633934] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.634218] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.634327] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.634949] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.635172] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.635471] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.635578] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.635715] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.635998] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.636093] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.636316] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eb8c8265-ddd7-41a1-a435-066f89c523e5 is going to be updated. [ 785.662351] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.662628] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.662628] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.662824] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.662978] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.671216] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eb8c8265-ddd7-41a1-a435-066f89c523e5 in Status: IN_PROGRESS for 2s [ 786.824069] env[69188]: INFO networking_nsxv3.common.synchronization [req-183a01db-019d-4b10-bf76-24d9819d1f2b req-fc1c02eb-b6c9-4742-a24b-2e71c00f7532 tempest-ServersTestJSON-1495057482 tempest-ServersTestJSON-1495057482-project-member] Enqueued Resource ID: 9f2518e8-b195-4520-b262-caa765ab7e27 with Priority: HIGHEST for action security_group_members [ 786.824612] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f2518e8-b195-4520-b262-caa765ab7e27 with Priority: HIGHEST for action security_group_members [ 786.824934] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-9f2518e8-b195-4520-b262-caa765ab7e27 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.825118] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9f2518e8-b195-4520-b262-caa765ab7e27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.825186] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9f2518e8-b195-4520-b262-caa765ab7e27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.825458] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9f2518e8-b195-4520-b262-caa765ab7e27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.825621] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.825719] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.825778] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.825923] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.826015] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.828043] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9f2518e8-b195-4520-b262-caa765ab7e27',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 787.121328] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock network-507 taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.121328] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "network-507" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.121328] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "network-507" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.121582] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "network-507" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.121934] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.122105] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.122218] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.122428] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.122626] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.123668] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 787.123668] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] NeedRegenerationException {{(pid=69188) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 787.123668] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] no value, waiting for create lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 787.123668] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] value creation lock acquired {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 787.123668] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 787.123668] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Calling creation function for not-yet-present value {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 787.123668] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 787.142555] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 787.142706] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69188) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 787.142847] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Released creation lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 787.143020] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "network-507" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.143323] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock port-e6af25bc-eb89-406e-a623-3a091c66254e taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.143489] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "port-e6af25bc-eb89-406e-a623-3a091c66254e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.143608] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "port-e6af25bc-eb89-406e-a623-3a091c66254e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.143927] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "port-e6af25bc-eb89-406e-a623-3a091c66254e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.144079] env[69188]: DEBUG networking_nsxv3.api.rpc [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e6af25bc-eb89-406e-a623-3a091c66254e',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 787.334259] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.334390] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.334593] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.334708] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.334825] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.335017] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.335125] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.335180] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.335755] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.335755] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.335755] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9f2518e8-b195-4520-b262-caa765ab7e27 already deleted. [ 787.335755] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9f2518e8-b195-4520-b262-caa765ab7e27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.646607] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.646975] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.647252] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.647964] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.647964] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.648303] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Segment Port e6af25bc-eb89-406e-a623-3a091c66254e not found, creating... [ 787.648737] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.648911] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.649439] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.649499] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.649666] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.650062] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.650287] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.650418] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.650695] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.650891] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.651053] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Resource: SegmentPort with ID: e6af25bc-eb89-406e-a623-3a091c66254e is going to be created. [ 787.669963] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.670179] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.670304] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.670584] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.670777] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.670994] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "port-e6af25bc-eb89-406e-a623-3a091c66254e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.678874] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eb8c8265-ddd7-41a1-a435-066f89c523e5 in Status: SUCCESS [ 787.679059] env[69188]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eb8c8265-ddd7-41a1-a435-066f89c523e5 deletion is rescheduled due to dependency. [ 787.679146] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eb8c8265-ddd7-41a1-a435-066f89c523e5" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.645987] env[69188]: INFO networking_nsxv3.common.synchronization [req-183a01db-019d-4b10-bf76-24d9819d1f2b req-e8fae809-7058-484f-8124-86e8e1c885b9 service nova] Enqueued Resource ID: 9f2518e8-b195-4520-b262-caa765ab7e27 with Priority: HIGHEST for action security_group_rules [ 788.646813] env[69188]: INFO networking_nsxv3.common.synchronization [req-183a01db-019d-4b10-bf76-24d9819d1f2b req-e8fae809-7058-484f-8124-86e8e1c885b9 service nova] Enqueued Resource ID: 9f2518e8-b195-4520-b262-caa765ab7e27 with Priority: HIGHEST for action security_group_members [ 788.647262] env[69188]: INFO networking_nsxv3.common.synchronization [req-183a01db-019d-4b10-bf76-24d9819d1f2b req-e8fae809-7058-484f-8124-86e8e1c885b9 service nova] Enqueued Resource ID: e6af25bc-eb89-406e-a623-3a091c66254e with Priority: HIGHEST for action port [ 788.647722] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f2518e8-b195-4520-b262-caa765ab7e27 with Priority: HIGHEST for action security_group_rules [ 788.647791] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f2518e8-b195-4520-b262-caa765ab7e27 with Priority: HIGHEST for action security_group_members [ 788.647893] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e6af25bc-eb89-406e-a623-3a091c66254e with Priority: HIGHEST for action port [ 788.648963] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9f2518e8-b195-4520-b262-caa765ab7e27 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.649119] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9f2518e8-b195-4520-b262-caa765ab7e27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.649184] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9f2518e8-b195-4520-b262-caa765ab7e27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.649640] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9f2518e8-b195-4520-b262-caa765ab7e27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.649640] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9f2518e8-b195-4520-b262-caa765ab7e27',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.651599] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-9f2518e8-b195-4520-b262-caa765ab7e27 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.651769] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9f2518e8-b195-4520-b262-caa765ab7e27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.651916] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9f2518e8-b195-4520-b262-caa765ab7e27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.652041] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9f2518e8-b195-4520-b262-caa765ab7e27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.652199] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.652306] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.652372] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.652520] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.652779] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.652779] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9f2518e8-b195-4520-b262-caa765ab7e27',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.654742] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-e6af25bc-eb89-406e-a623-3a091c66254e taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.654885] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e6af25bc-eb89-406e-a623-3a091c66254e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.655044] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e6af25bc-eb89-406e-a623-3a091c66254e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.655325] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e6af25bc-eb89-406e-a623-3a091c66254e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.655435] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e6af25bc-eb89-406e-a623-3a091c66254e',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.157904] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9f2518e8-b195-4520-b262-caa765ab7e27',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.157904] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-9f2518e8-b195-4520-b262-caa765ab7e27 taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.157904] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9f2518e8-b195-4520-b262-caa765ab7e27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.157904] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e6af25bc-eb89-406e-a623-3a091c66254e with status ACTIVE [ 789.157904] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.157904] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.157904] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.157904] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.158407] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.158407] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.158407] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.158407] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.158544] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.158544] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.158765] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.160084] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.160084] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.160084] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.160084] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.160084] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e6af25bc-eb89-406e-a623-3a091c66254e is going to be updated. [ 789.179791] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.179946] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.179946] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.180400] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.180400] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.180523] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e6af25bc-eb89-406e-a623-3a091c66254e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.485142] env[69188]: INFO networking_nsxv3.common.synchronization [req-7291395e-18a4-465f-ae9a-6d6ebdd3faa8 req-4e606c69-b4de-4175-9337-90333ba4f7f4 tempest-ServersTestMultiNic-1128640872 tempest-ServersTestMultiNic-1128640872-project-member] Enqueued Resource ID: d7156740-676b-417b-9850-f10d741c20bd with Priority: HIGHEST for action security_group_members [ 789.485968] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d7156740-676b-417b-9850-f10d741c20bd with Priority: HIGHEST for action security_group_members [ 789.485968] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-d7156740-676b-417b-9850-f10d741c20bd taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.486180] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d7156740-676b-417b-9850-f10d741c20bd" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.486180] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d7156740-676b-417b-9850-f10d741c20bd" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.486372] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d7156740-676b-417b-9850-f10d741c20bd" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.486543] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.486639] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.486921] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.486921] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.486921] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.487225] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d7156740-676b-417b-9850-f10d741c20bd',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.662578] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9f2518e8-b195-4520-b262-caa765ab7e27',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.677266] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.677411] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.677545] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.677747] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.677836] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.677923] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9f2518e8-b195-4520-b262-caa765ab7e27 is going to be created. [ 789.704017] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.704017] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.704017] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.704017] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.704017] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.714565] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9f2518e8-b195-4520-b262-caa765ab7e27 in Status: UNINITIALIZED for 2s [ 789.989827] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.990029] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.990105] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.990316] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.990409] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.990609] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.990703] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.990767] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.990909] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.990982] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.991081] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d7156740-676b-417b-9850-f10d741c20bd already deleted. [ 789.991161] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d7156740-676b-417b-9850-f10d741c20bd" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.019110] env[69188]: INFO networking_nsxv3.common.synchronization [req-7291395e-18a4-465f-ae9a-6d6ebdd3faa8 req-33bb2af9-6cda-454d-b521-f7aed4cd33db tempest-ServersTestMultiNic-1128640872 tempest-ServersTestMultiNic-1128640872-project-member] Enqueued Resource ID: d7156740-676b-417b-9850-f10d741c20bd with Priority: HIGHEST for action security_group_members [ 790.019621] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d7156740-676b-417b-9850-f10d741c20bd with Priority: HIGHEST for action security_group_members [ 790.019916] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-d7156740-676b-417b-9850-f10d741c20bd taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.020047] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d7156740-676b-417b-9850-f10d741c20bd" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.020116] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d7156740-676b-417b-9850-f10d741c20bd" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.020305] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d7156740-676b-417b-9850-f10d741c20bd" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.020452] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.020549] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.020612] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.020751] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.020832] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.020921] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d7156740-676b-417b-9850-f10d741c20bd',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.313240] env[69188]: INFO networking_nsxv3.common.synchronization [req-7291395e-18a4-465f-ae9a-6d6ebdd3faa8 req-ef65a6d0-b0a9-4cd6-9ba2-9c9e9b2acb63 tempest-ServersTestMultiNic-1128640872 tempest-ServersTestMultiNic-1128640872-project-member] Enqueued Resource ID: d7156740-676b-417b-9850-f10d741c20bd with Priority: HIGHEST for action security_group_members [ 790.314466] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d7156740-676b-417b-9850-f10d741c20bd with Priority: HIGHEST for action security_group_members [ 790.314466] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-d7156740-676b-417b-9850-f10d741c20bd taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.314466] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d7156740-676b-417b-9850-f10d741c20bd" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.523741] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.523850] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.523850] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.524069] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.524172] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.524369] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.524478] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.524537] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.524701] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.524815] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.524881] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d7156740-676b-417b-9850-f10d741c20bd already deleted. [ 790.525092] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d7156740-676b-417b-9850-f10d741c20bd" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.525092] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d7156740-676b-417b-9850-f10d741c20bd" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.525232] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d7156740-676b-417b-9850-f10d741c20bd" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.525373] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.525481] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.525571] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.525687] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.525762] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.525853] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d7156740-676b-417b-9850-f10d741c20bd',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.613601] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock network-470 taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.613805] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "network-470" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.613928] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "network-470" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.614287] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "network-470" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.614554] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.614720] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.614836] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.615078] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.615206] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.615407] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 790.615518] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] NeedRegenerationException {{(pid=69188) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 790.615627] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] no value, waiting for create lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 790.615733] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] value creation lock acquired {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 790.616073] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 790.616073] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Calling creation function for not-yet-present value {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 790.616073] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 790.636132] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 790.636288] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69188) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 790.638048] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Released creation lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 790.638048] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "network-470" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.638048] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock port-f779f7d2-eaf1-4faa-b42d-926f8e51ea96 taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.638048] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "port-f779f7d2-eaf1-4faa-b42d-926f8e51ea96" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.638553] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "port-f779f7d2-eaf1-4faa-b42d-926f8e51ea96" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.638852] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "port-f779f7d2-eaf1-4faa-b42d-926f8e51ea96" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.639218] env[69188]: DEBUG networking_nsxv3.api.rpc [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f779f7d2-eaf1-4faa-b42d-926f8e51ea96',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.031685] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.031999] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.031999] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.032142] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.032235] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.032428] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.032526] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.032600] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.032746] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.032822] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.032907] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d7156740-676b-417b-9850-f10d741c20bd already deleted. [ 791.032983] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d7156740-676b-417b-9850-f10d741c20bd" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.141566] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.141935] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.141985] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.142406] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.142611] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.142836] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Segment Port f779f7d2-eaf1-4faa-b42d-926f8e51ea96 not found, creating... [ 791.143382] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.143476] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.143595] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.143826] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.144177] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.144498] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.144615] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.144729] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.144936] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.145080] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.145217] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Resource: SegmentPort with ID: f779f7d2-eaf1-4faa-b42d-926f8e51ea96 is going to be created. [ 791.164045] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.164251] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.164371] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.164631] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.164849] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.165086] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "port-f779f7d2-eaf1-4faa-b42d-926f8e51ea96" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.721320] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9f2518e8-b195-4520-b262-caa765ab7e27 in Status: SUCCESS [ 791.721590] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9f2518e8-b195-4520-b262-caa765ab7e27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.721705] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9f2518e8-b195-4520-b262-caa765ab7e27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.721929] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9f2518e8-b195-4520-b262-caa765ab7e27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.722138] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.722253] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.722334] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.722516] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.722603] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.722690] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9f2518e8-b195-4520-b262-caa765ab7e27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.722795] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9f2518e8-b195-4520-b262-caa765ab7e27',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.064141] env[69188]: INFO networking_nsxv3.common.synchronization [req-7291395e-18a4-465f-ae9a-6d6ebdd3faa8 req-b3c1b9b3-4ba4-4e7e-948c-634208886c61 service nova] Enqueued Resource ID: d7156740-676b-417b-9850-f10d741c20bd with Priority: HIGHEST for action security_group_rules [ 792.064410] env[69188]: INFO networking_nsxv3.common.synchronization [req-7291395e-18a4-465f-ae9a-6d6ebdd3faa8 req-b3c1b9b3-4ba4-4e7e-948c-634208886c61 service nova] Enqueued Resource ID: d7156740-676b-417b-9850-f10d741c20bd with Priority: HIGHEST for action security_group_members [ 792.064454] env[69188]: INFO networking_nsxv3.common.synchronization [req-7291395e-18a4-465f-ae9a-6d6ebdd3faa8 req-b3c1b9b3-4ba4-4e7e-948c-634208886c61 service nova] Enqueued Resource ID: f779f7d2-eaf1-4faa-b42d-926f8e51ea96 with Priority: HIGHEST for action port [ 792.064679] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d7156740-676b-417b-9850-f10d741c20bd with Priority: HIGHEST for action security_group_rules [ 792.064911] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d7156740-676b-417b-9850-f10d741c20bd with Priority: HIGHEST for action security_group_members [ 792.064911] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f779f7d2-eaf1-4faa-b42d-926f8e51ea96 with Priority: HIGHEST for action port [ 792.065482] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d7156740-676b-417b-9850-f10d741c20bd taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.065618] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d7156740-676b-417b-9850-f10d741c20bd" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.065687] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d7156740-676b-417b-9850-f10d741c20bd" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.065939] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d7156740-676b-417b-9850-f10d741c20bd" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.067485] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d7156740-676b-417b-9850-f10d741c20bd',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.068771] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-d7156740-676b-417b-9850-f10d741c20bd taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.068870] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d7156740-676b-417b-9850-f10d741c20bd" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.068910] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d7156740-676b-417b-9850-f10d741c20bd" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.069091] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d7156740-676b-417b-9850-f10d741c20bd" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.071343] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.071343] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.071343] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.071343] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.071343] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.071343] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d7156740-676b-417b-9850-f10d741c20bd',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.073088] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-f779f7d2-eaf1-4faa-b42d-926f8e51ea96 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.073190] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f779f7d2-eaf1-4faa-b42d-926f8e51ea96" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.073244] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f779f7d2-eaf1-4faa-b42d-926f8e51ea96" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.076056] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f779f7d2-eaf1-4faa-b42d-926f8e51ea96" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.076056] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f779f7d2-eaf1-4faa-b42d-926f8e51ea96',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.100631] env[69188]: INFO networking_nsxv3.common.synchronization [None req-6c74a106-a037-4945-b1e1-6644500b1ac1 None None] Enqueued Resource ID: aa72e829-878a-4eb4-a938-f10b80d14594 with Priority: HIGHEST for action port [ 792.101136] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa72e829-878a-4eb4-a938-f10b80d14594 with Priority: HIGHEST for action port [ 792.102103] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-aa72e829-878a-4eb4-a938-f10b80d14594 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.102103] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-aa72e829-878a-4eb4-a938-f10b80d14594" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.102103] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-aa72e829-878a-4eb4-a938-f10b80d14594" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.102103] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-aa72e829-878a-4eb4-a938-f10b80d14594" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.102103] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aa72e829-878a-4eb4-a938-f10b80d14594',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.211947] env[69188]: INFO networking_nsxv3.common.synchronization [req-1b9d6adf-e83b-4c04-ba42-c123fb04c074 req-c6b8401a-c5d2-4ff8-9480-6d840573e43f tempest-ServerRescueTestJSONUnderV235-1972914019 tempest-ServerRescueTestJSONUnderV235-1972914019-project-member] Enqueued Resource ID: 44c5b379-bd5b-44a8-ad31-bc9a9b51d60e with Priority: HIGHEST for action security_group_members [ 792.212229] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 44c5b379-bd5b-44a8-ad31-bc9a9b51d60e with Priority: HIGHEST for action security_group_members [ 792.216019] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-44c5b379-bd5b-44a8-ad31-bc9a9b51d60e taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.216019] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-44c5b379-bd5b-44a8-ad31-bc9a9b51d60e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.216019] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-44c5b379-bd5b-44a8-ad31-bc9a9b51d60e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.216019] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-44c5b379-bd5b-44a8-ad31-bc9a9b51d60e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.216019] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.216019] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.216019] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.216019] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.216019] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.216019] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('44c5b379-bd5b-44a8-ad31-bc9a9b51d60e',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.227176] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-9f2518e8-b195-4520-b262-caa765ab7e27 taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.227176] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9f2518e8-b195-4520-b262-caa765ab7e27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.227176] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9f2518e8-b195-4520-b262-caa765ab7e27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.227176] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9f2518e8-b195-4520-b262-caa765ab7e27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.227176] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.227176] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.227176] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.227176] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.227176] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.227176] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9f2518e8-b195-4520-b262-caa765ab7e27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.227176] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-9f2518e8-b195-4520-b262-caa765ab7e27 taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.227176] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9f2518e8-b195-4520-b262-caa765ab7e27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.228214] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9f2518e8-b195-4520-b262-caa765ab7e27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.228214] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9f2518e8-b195-4520-b262-caa765ab7e27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.228214] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.228214] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.228214] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.228214] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.228214] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.228214] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9f2518e8-b195-4520-b262-caa765ab7e27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.228214] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9f2518e8-b195-4520-b262-caa765ab7e27',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.535179] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock network-868 taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.535179] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "network-868" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.535179] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "network-868" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.535179] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "network-868" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.535179] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.535457] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.535697] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.536286] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.536286] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.536286] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 792.536421] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] NeedRegenerationException {{(pid=69188) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 792.536750] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] no value, waiting for create lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 792.536750] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] value creation lock acquired {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 792.536750] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 792.536933] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Calling creation function for not-yet-present value {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 792.536933] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 792.559518] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 792.559518] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69188) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 792.559518] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Released creation lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 792.559518] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "network-868" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.559518] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock port-11a341eb-c60a-4b7d-9c89-13cf16638e62 taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.559518] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "port-11a341eb-c60a-4b7d-9c89-13cf16638e62" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.559518] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "port-11a341eb-c60a-4b7d-9c89-13cf16638e62" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.559518] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "port-11a341eb-c60a-4b7d-9c89-13cf16638e62" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.559518] env[69188]: DEBUG networking_nsxv3.api.rpc [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('11a341eb-c60a-4b7d-9c89-13cf16638e62',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.569725] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-d7156740-676b-417b-9850-f10d741c20bd taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.569725] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d7156740-676b-417b-9850-f10d741c20bd" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.574165] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d7156740-676b-417b-9850-f10d741c20bd',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.576928] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f779f7d2-eaf1-4faa-b42d-926f8e51ea96 with status ACTIVE [ 792.577941] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.577941] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.577941] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.577941] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.577941] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.577941] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.578185] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.578216] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.578391] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.579302] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.579393] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.579501] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.579998] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.579998] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.579998] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.579998] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f779f7d2-eaf1-4faa-b42d-926f8e51ea96 is going to be updated. [ 792.604771] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.604908] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.604982] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.605207] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.605338] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.605517] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f779f7d2-eaf1-4faa-b42d-926f8e51ea96" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.606022] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port aa72e829-878a-4eb4-a938-f10b80d14594 [ 792.606202] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.606308] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.606374] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.606585] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.606637] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.606703] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:aa72e829-878a-4eb4-a938-f10b80d14594 already deleted. [ 792.606779] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-aa72e829-878a-4eb4-a938-f10b80d14594" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.717672] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.719481] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.719481] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.719481] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.719481] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.719481] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.719481] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.719481] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.719481] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.719481] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.719481] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 44c5b379-bd5b-44a8-ad31-bc9a9b51d60e already deleted. [ 792.719481] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-44c5b379-bd5b-44a8-ad31-bc9a9b51d60e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.731873] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9f2518e8-b195-4520-b262-caa765ab7e27: rpc.has_security_group_logging(os_id): False [ 792.751510] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.752730] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.752730] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.752730] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.752730] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.752730] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.752730] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.752730] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.752730] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.752730] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.753074] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.753074] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.753074] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.753178] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.753178] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.753819] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.753819] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.753819] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.753819] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.753819] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.754071] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9f2518e8-b195-4520-b262-caa765ab7e27 is going to be created. [ 792.809453] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.809596] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.809666] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.809931] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.810128] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.823216] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9f2518e8-b195-4520-b262-caa765ab7e27 in Status: IN_PROGRESS for 2s [ 792.934924] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock network-422 taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.935171] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "network-422" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.935316] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "network-422" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.935693] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "network-422" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.939036] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.939036] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.939036] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.939036] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.939036] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.939036] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 792.939036] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] NeedRegenerationException {{(pid=69188) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 792.939036] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] no value, waiting for create lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 792.939036] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] value creation lock acquired {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 792.939036] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 792.939036] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Calling creation function for not-yet-present value {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 792.939036] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 792.956728] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 792.956728] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69188) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 792.956728] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Released creation lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 792.956728] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "network-422" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.956728] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock port-a1225ba6-a825-49f9-af4c-a1a74c8b43ee taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.956995] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "port-a1225ba6-a825-49f9-af4c-a1a74c8b43ee" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.956995] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "port-a1225ba6-a825-49f9-af4c-a1a74c8b43ee" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.957297] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "port-a1225ba6-a825-49f9-af4c-a1a74c8b43ee" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.957500] env[69188]: DEBUG networking_nsxv3.api.rpc [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a1225ba6-a825-49f9-af4c-a1a74c8b43ee',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.062849] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.062849] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.062849] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.063578] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.063578] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.063578] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Segment Port 11a341eb-c60a-4b7d-9c89-13cf16638e62 not found, creating... [ 793.063578] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.063875] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.063875] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.064099] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.064667] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.064667] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.065145] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.065145] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.065145] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.066996] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.066996] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Resource: SegmentPort with ID: 11a341eb-c60a-4b7d-9c89-13cf16638e62 is going to be created. [ 793.076155] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d7156740-676b-417b-9850-f10d741c20bd',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.091591] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.091591] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.091591] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.091591] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.091591] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.091591] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "port-11a341eb-c60a-4b7d-9c89-13cf16638e62" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.460558] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.460759] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.460896] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.462342] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.466022] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.466022] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Segment Port a1225ba6-a825-49f9-af4c-a1a74c8b43ee not found, creating... [ 793.466022] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.466022] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.466022] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.466022] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.466022] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.466022] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.466022] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.466022] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.466717] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.466717] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.466717] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Resource: SegmentPort with ID: a1225ba6-a825-49f9-af4c-a1a74c8b43ee is going to be created. [ 793.488807] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.488807] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.488807] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.488807] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.488807] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.488807] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "port-a1225ba6-a825-49f9-af4c-a1a74c8b43ee" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.579009] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.579192] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.579264] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.579464] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.579558] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.579654] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d7156740-676b-417b-9850-f10d741c20bd is going to be created. [ 793.612086] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.612285] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.612320] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.612758] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.612954] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.624260] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d7156740-676b-417b-9850-f10d741c20bd in Status: UNINITIALIZED for 2s [ 793.818411] env[69188]: INFO networking_nsxv3.common.synchronization [req-1b9d6adf-e83b-4c04-ba42-c123fb04c074 req-f8a2bbd7-6f1e-4276-b2d9-e6b55141d24f service nova] Enqueued Resource ID: 44c5b379-bd5b-44a8-ad31-bc9a9b51d60e with Priority: HIGHEST for action security_group_rules [ 793.818411] env[69188]: INFO networking_nsxv3.common.synchronization [req-1b9d6adf-e83b-4c04-ba42-c123fb04c074 req-f8a2bbd7-6f1e-4276-b2d9-e6b55141d24f service nova] Enqueued Resource ID: 44c5b379-bd5b-44a8-ad31-bc9a9b51d60e with Priority: HIGHEST for action security_group_members [ 793.818691] env[69188]: INFO networking_nsxv3.common.synchronization [req-1b9d6adf-e83b-4c04-ba42-c123fb04c074 req-f8a2bbd7-6f1e-4276-b2d9-e6b55141d24f service nova] Enqueued Resource ID: 11a341eb-c60a-4b7d-9c89-13cf16638e62 with Priority: HIGHEST for action port [ 793.818891] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 44c5b379-bd5b-44a8-ad31-bc9a9b51d60e with Priority: HIGHEST for action security_group_rules [ 793.819184] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 44c5b379-bd5b-44a8-ad31-bc9a9b51d60e with Priority: HIGHEST for action security_group_members [ 793.819352] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 11a341eb-c60a-4b7d-9c89-13cf16638e62 with Priority: HIGHEST for action port [ 793.819965] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-44c5b379-bd5b-44a8-ad31-bc9a9b51d60e taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.820107] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-44c5b379-bd5b-44a8-ad31-bc9a9b51d60e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.820170] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-44c5b379-bd5b-44a8-ad31-bc9a9b51d60e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.820477] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-44c5b379-bd5b-44a8-ad31-bc9a9b51d60e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.820565] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('44c5b379-bd5b-44a8-ad31-bc9a9b51d60e',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.821387] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-44c5b379-bd5b-44a8-ad31-bc9a9b51d60e taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.821537] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-44c5b379-bd5b-44a8-ad31-bc9a9b51d60e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.821648] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-44c5b379-bd5b-44a8-ad31-bc9a9b51d60e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.821733] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-44c5b379-bd5b-44a8-ad31-bc9a9b51d60e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.825087] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.825087] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.825087] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.825087] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.825087] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.825087] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('44c5b379-bd5b-44a8-ad31-bc9a9b51d60e',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.825087] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-11a341eb-c60a-4b7d-9c89-13cf16638e62 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.825087] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-11a341eb-c60a-4b7d-9c89-13cf16638e62" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.825087] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-11a341eb-c60a-4b7d-9c89-13cf16638e62" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.825087] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-11a341eb-c60a-4b7d-9c89-13cf16638e62" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.825087] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('11a341eb-c60a-4b7d-9c89-13cf16638e62',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.211406] env[69188]: INFO networking_nsxv3.common.synchronization [req-7291395e-18a4-465f-ae9a-6d6ebdd3faa8 req-666d308c-bfcf-4783-9117-cd58b453856c service nova] Enqueued Resource ID: d7156740-676b-417b-9850-f10d741c20bd with Priority: HIGHEST for action security_group_rules [ 794.211695] env[69188]: INFO networking_nsxv3.common.synchronization [req-7291395e-18a4-465f-ae9a-6d6ebdd3faa8 req-666d308c-bfcf-4783-9117-cd58b453856c service nova] Enqueued Resource ID: d7156740-676b-417b-9850-f10d741c20bd with Priority: HIGHEST for action security_group_members [ 794.211934] env[69188]: INFO networking_nsxv3.common.synchronization [req-7291395e-18a4-465f-ae9a-6d6ebdd3faa8 req-666d308c-bfcf-4783-9117-cd58b453856c service nova] Enqueued Resource ID: a1225ba6-a825-49f9-af4c-a1a74c8b43ee with Priority: HIGHEST for action port [ 794.212188] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d7156740-676b-417b-9850-f10d741c20bd with Priority: HIGHEST for action security_group_rules [ 794.212319] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d7156740-676b-417b-9850-f10d741c20bd with Priority: HIGHEST for action security_group_members [ 794.212415] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a1225ba6-a825-49f9-af4c-a1a74c8b43ee with Priority: HIGHEST for action port [ 794.212993] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d7156740-676b-417b-9850-f10d741c20bd taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.213109] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d7156740-676b-417b-9850-f10d741c20bd" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.213297] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-d7156740-676b-417b-9850-f10d741c20bd taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.213422] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d7156740-676b-417b-9850-f10d741c20bd" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.213542] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-a1225ba6-a825-49f9-af4c-a1a74c8b43ee taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.213647] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a1225ba6-a825-49f9-af4c-a1a74c8b43ee" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.213720] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a1225ba6-a825-49f9-af4c-a1a74c8b43ee" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.213950] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a1225ba6-a825-49f9-af4c-a1a74c8b43ee" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.214073] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a1225ba6-a825-49f9-af4c-a1a74c8b43ee',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.325896] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-44c5b379-bd5b-44a8-ad31-bc9a9b51d60e taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.326094] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-44c5b379-bd5b-44a8-ad31-bc9a9b51d60e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.326236] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('44c5b379-bd5b-44a8-ad31-bc9a9b51d60e',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.327080] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 11a341eb-c60a-4b7d-9c89-13cf16638e62 with status ACTIVE [ 794.331020] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.331020] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.331020] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.331020] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.331020] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.331020] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.331020] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.331020] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.331020] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.331020] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.331020] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.331020] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.331020] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.331020] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.331020] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.331020] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 11a341eb-c60a-4b7d-9c89-13cf16638e62 is going to be updated. [ 794.353878] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.354068] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.354142] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.354293] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.354428] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.354583] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-11a341eb-c60a-4b7d-9c89-13cf16638e62" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.692090] env[69188]: INFO networking_nsxv3.common.synchronization [None req-0f67def4-7924-4185-9e65-f5c3d2feb0ec None None] Enqueued Resource ID: 62950d13-da89-4863-945a-eb91f21ae67f with Priority: HIGHEST for action port [ 794.692345] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 62950d13-da89-4863-945a-eb91f21ae67f with Priority: HIGHEST for action port [ 794.692893] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-62950d13-da89-4863-945a-eb91f21ae67f taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.693070] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-62950d13-da89-4863-945a-eb91f21ae67f" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.693145] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-62950d13-da89-4863-945a-eb91f21ae67f" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.694199] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-62950d13-da89-4863-945a-eb91f21ae67f" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.694313] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('62950d13-da89-4863-945a-eb91f21ae67f',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.715622] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a1225ba6-a825-49f9-af4c-a1a74c8b43ee with status ACTIVE [ 794.715849] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.715986] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.716060] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.716369] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.716369] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.716552] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.716672] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.716672] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.716817] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.716896] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.717216] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.717216] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.717216] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.717365] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.717455] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.717558] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a1225ba6-a825-49f9-af4c-a1a74c8b43ee is going to be updated. [ 794.743733] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.743925] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.743925] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.744152] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.744286] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.744443] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a1225ba6-a825-49f9-af4c-a1a74c8b43ee" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.830963] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('44c5b379-bd5b-44a8-ad31-bc9a9b51d60e',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.838821] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9f2518e8-b195-4520-b262-caa765ab7e27 in Status: SUCCESS [ 794.838933] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9f2518e8-b195-4520-b262-caa765ab7e27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.119096] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock network-470 taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.119096] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "network-470" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.119096] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "network-470" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.119096] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "network-470" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.119453] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.119647] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.119916] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.122930] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.122930] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.122930] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 795.122930] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] NeedRegenerationException {{(pid=69188) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 795.122930] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] no value, waiting for create lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 795.122930] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] value creation lock acquired {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 795.122930] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 795.122930] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Calling creation function for not-yet-present value {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 795.122930] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 795.142061] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 795.142427] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69188) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 795.142651] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Released creation lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 795.143448] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "network-470" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.143448] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock port-ebab695f-53c0-425a-a081-1577aa2f5afa taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.144110] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "port-ebab695f-53c0-425a-a081-1577aa2f5afa" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.144110] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "port-ebab695f-53c0-425a-a081-1577aa2f5afa" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.144455] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "port-ebab695f-53c0-425a-a081-1577aa2f5afa" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.144629] env[69188]: DEBUG networking_nsxv3.api.rpc [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ebab695f-53c0-425a-a081-1577aa2f5afa',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.198295] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 62950d13-da89-4863-945a-eb91f21ae67f [ 795.198295] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.198295] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.198295] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.198295] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.198295] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.198295] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:62950d13-da89-4863-945a-eb91f21ae67f already deleted. [ 795.198295] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-62950d13-da89-4863-945a-eb91f21ae67f" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.333100] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.333100] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.333100] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.335037] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.335037] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.335037] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 44c5b379-bd5b-44a8-ad31-bc9a9b51d60e is going to be created. [ 795.357128] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.357309] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.357383] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.358247] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.358247] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.369826] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 44c5b379-bd5b-44a8-ad31-bc9a9b51d60e in Status: UNINITIALIZED for 2s [ 795.634155] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d7156740-676b-417b-9850-f10d741c20bd in Status: UNINITIALIZED for 4s [ 795.648972] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.648972] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.649193] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.649456] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.649635] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.649837] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Segment Port ebab695f-53c0-425a-a081-1577aa2f5afa not found, creating... [ 795.650175] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.650369] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.650983] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.650983] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.650983] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.655150] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.655150] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.655150] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.655150] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.655150] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.655150] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Resource: SegmentPort with ID: ebab695f-53c0-425a-a081-1577aa2f5afa is going to be created. [ 795.670583] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.670894] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.671035] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.673049] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.673049] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.673049] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "port-ebab695f-53c0-425a-a081-1577aa2f5afa" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.827967] env[69188]: INFO networking_nsxv3.common.synchronization [req-e703fac6-2b68-45c0-aa4c-beb2fdbe7655 req-c8616bf0-f3e7-4033-9aec-7e94ce079b60 tempest-ImagesTestJSON-2034330654 tempest-ImagesTestJSON-2034330654-project-member] Enqueued Resource ID: 199db626-eef5-4a20-b92a-585841c1cff4 with Priority: HIGHEST for action security_group_members [ 795.828556] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 199db626-eef5-4a20-b92a-585841c1cff4 with Priority: HIGHEST for action security_group_members [ 795.828901] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-199db626-eef5-4a20-b92a-585841c1cff4 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.829167] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-199db626-eef5-4a20-b92a-585841c1cff4" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.829201] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-199db626-eef5-4a20-b92a-585841c1cff4" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.829535] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-199db626-eef5-4a20-b92a-585841c1cff4" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.829777] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.829942] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.830066] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.830285] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.830414] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.830545] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('199db626-eef5-4a20-b92a-585841c1cff4',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.315961] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock network-410 taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.317758] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "network-410" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.317758] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "network-410" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.317758] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "network-410" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.317758] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.317758] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.317758] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.318242] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.318727] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.318945] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 796.319072] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] NeedRegenerationException {{(pid=69188) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 796.320128] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] no value, waiting for create lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 796.320252] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] value creation lock acquired {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 796.320371] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 796.320488] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Calling creation function for not-yet-present value {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 796.320625] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 796.334544] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.334544] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.334544] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.334920] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.334920] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.334920] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.335122] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.335122] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.335224] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.335301] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.335391] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 199db626-eef5-4a20-b92a-585841c1cff4 already deleted. [ 796.335580] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-199db626-eef5-4a20-b92a-585841c1cff4" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.337441] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 796.337762] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=69188) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 796.337941] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Released creation lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 796.338129] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "network-410" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.338565] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock port-fd6a5cb9-91c7-48a9-a002-6504eb2b96d9 taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.338693] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "port-fd6a5cb9-91c7-48a9-a002-6504eb2b96d9" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.338813] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "port-fd6a5cb9-91c7-48a9-a002-6504eb2b96d9" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.339099] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "port-fd6a5cb9-91c7-48a9-a002-6504eb2b96d9" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.339239] env[69188]: DEBUG networking_nsxv3.api.rpc [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fd6a5cb9-91c7-48a9-a002-6504eb2b96d9',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.498228] env[69188]: INFO networking_nsxv3.common.synchronization [req-7291395e-18a4-465f-ae9a-6d6ebdd3faa8 req-7cd3c952-9086-44f5-8181-52880efabeef service nova] Enqueued Resource ID: d7156740-676b-417b-9850-f10d741c20bd with Priority: HIGHEST for action security_group_rules [ 796.498228] env[69188]: INFO networking_nsxv3.common.synchronization [req-7291395e-18a4-465f-ae9a-6d6ebdd3faa8 req-7cd3c952-9086-44f5-8181-52880efabeef service nova] Enqueued Resource ID: d7156740-676b-417b-9850-f10d741c20bd with Priority: HIGHEST for action security_group_members [ 796.498228] env[69188]: INFO networking_nsxv3.common.synchronization [req-7291395e-18a4-465f-ae9a-6d6ebdd3faa8 req-7cd3c952-9086-44f5-8181-52880efabeef service nova] Enqueued Resource ID: ebab695f-53c0-425a-a081-1577aa2f5afa with Priority: HIGHEST for action port [ 796.498228] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d7156740-676b-417b-9850-f10d741c20bd with Priority: HIGHEST for action security_group_rules [ 796.498228] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d7156740-676b-417b-9850-f10d741c20bd with Priority: HIGHEST for action security_group_members [ 796.498228] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ebab695f-53c0-425a-a081-1577aa2f5afa with Priority: HIGHEST for action port [ 796.498228] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d7156740-676b-417b-9850-f10d741c20bd taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.498228] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d7156740-676b-417b-9850-f10d741c20bd" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.499235] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-d7156740-676b-417b-9850-f10d741c20bd taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.499361] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d7156740-676b-417b-9850-f10d741c20bd" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.499560] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-ebab695f-53c0-425a-a081-1577aa2f5afa taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.499672] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ebab695f-53c0-425a-a081-1577aa2f5afa" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.499734] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ebab695f-53c0-425a-a081-1577aa2f5afa" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.500237] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ebab695f-53c0-425a-a081-1577aa2f5afa" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.500237] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ebab695f-53c0-425a-a081-1577aa2f5afa',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.841455] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.841631] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.841764] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.842066] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.842408] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.842573] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Segment Port fd6a5cb9-91c7-48a9-a002-6504eb2b96d9 not found, creating... [ 796.842860] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.842992] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.843113] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.843338] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.843977] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.843977] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.843977] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.844164] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.845038] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.845038] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.845038] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Resource: SegmentPort with ID: fd6a5cb9-91c7-48a9-a002-6504eb2b96d9 is going to be created. [ 796.864559] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.864737] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.864859] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.865121] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.865338] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.865596] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "port-fd6a5cb9-91c7-48a9-a002-6504eb2b96d9" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.002072] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ebab695f-53c0-425a-a081-1577aa2f5afa with status ACTIVE [ 797.002358] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.002521] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.002521] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.003020] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.003020] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.003020] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.003159] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.003159] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.003274] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.003350] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.003647] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.003848] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.003848] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.003943] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.003943] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.004038] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ebab695f-53c0-425a-a081-1577aa2f5afa is going to be updated. [ 797.027325] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.027427] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.027427] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.027672] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.027803] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.027964] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ebab695f-53c0-425a-a081-1577aa2f5afa" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.378796] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 44c5b379-bd5b-44a8-ad31-bc9a9b51d60e in Status: SUCCESS [ 797.379069] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-44c5b379-bd5b-44a8-ad31-bc9a9b51d60e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.379195] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-44c5b379-bd5b-44a8-ad31-bc9a9b51d60e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.379402] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-44c5b379-bd5b-44a8-ad31-bc9a9b51d60e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.379595] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.379727] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.380510] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.380510] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.380510] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.380510] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-44c5b379-bd5b-44a8-ad31-bc9a9b51d60e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.380510] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('44c5b379-bd5b-44a8-ad31-bc9a9b51d60e',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.603092] env[69188]: INFO networking_nsxv3.common.synchronization [req-e703fac6-2b68-45c0-aa4c-beb2fdbe7655 req-257ed353-42cb-48eb-a8bb-cb9ad60515b7 service nova] Enqueued Resource ID: 199db626-eef5-4a20-b92a-585841c1cff4 with Priority: HIGHEST for action security_group_rules [ 797.603289] env[69188]: INFO networking_nsxv3.common.synchronization [req-e703fac6-2b68-45c0-aa4c-beb2fdbe7655 req-257ed353-42cb-48eb-a8bb-cb9ad60515b7 service nova] Enqueued Resource ID: 199db626-eef5-4a20-b92a-585841c1cff4 with Priority: HIGHEST for action security_group_members [ 797.603448] env[69188]: INFO networking_nsxv3.common.synchronization [req-e703fac6-2b68-45c0-aa4c-beb2fdbe7655 req-257ed353-42cb-48eb-a8bb-cb9ad60515b7 service nova] Enqueued Resource ID: fd6a5cb9-91c7-48a9-a002-6504eb2b96d9 with Priority: HIGHEST for action port [ 797.603922] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 199db626-eef5-4a20-b92a-585841c1cff4 with Priority: HIGHEST for action security_group_rules [ 797.604071] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 199db626-eef5-4a20-b92a-585841c1cff4 with Priority: HIGHEST for action security_group_members [ 797.604173] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd6a5cb9-91c7-48a9-a002-6504eb2b96d9 with Priority: HIGHEST for action port [ 797.604705] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-199db626-eef5-4a20-b92a-585841c1cff4 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.604834] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-199db626-eef5-4a20-b92a-585841c1cff4" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.604901] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-199db626-eef5-4a20-b92a-585841c1cff4" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.605160] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-199db626-eef5-4a20-b92a-585841c1cff4" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.605243] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('199db626-eef5-4a20-b92a-585841c1cff4',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.606049] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-199db626-eef5-4a20-b92a-585841c1cff4 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.606256] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-199db626-eef5-4a20-b92a-585841c1cff4" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.606321] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-199db626-eef5-4a20-b92a-585841c1cff4" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.606504] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-199db626-eef5-4a20-b92a-585841c1cff4" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.606659] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.606753] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.606816] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.606960] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.607064] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.607151] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('199db626-eef5-4a20-b92a-585841c1cff4',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.608045] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-fd6a5cb9-91c7-48a9-a002-6504eb2b96d9 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.608045] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fd6a5cb9-91c7-48a9-a002-6504eb2b96d9" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.608045] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fd6a5cb9-91c7-48a9-a002-6504eb2b96d9" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.608194] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fd6a5cb9-91c7-48a9-a002-6504eb2b96d9" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.608272] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fd6a5cb9-91c7-48a9-a002-6504eb2b96d9',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.645671] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d7156740-676b-417b-9850-f10d741c20bd in Status: SUCCESS [ 797.645891] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d7156740-676b-417b-9850-f10d741c20bd" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.646062] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d7156740-676b-417b-9850-f10d741c20bd" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.646275] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d7156740-676b-417b-9850-f10d741c20bd" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.646974] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.646974] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.646974] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.646974] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.646974] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.646974] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d7156740-676b-417b-9850-f10d741c20bd" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.647249] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d7156740-676b-417b-9850-f10d741c20bd',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.647818] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d7156740-676b-417b-9850-f10d741c20bd" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.647974] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d7156740-676b-417b-9850-f10d741c20bd" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.648143] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.648241] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.648305] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.648442] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.648533] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.648641] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d7156740-676b-417b-9850-f10d741c20bd',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.885059] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-44c5b379-bd5b-44a8-ad31-bc9a9b51d60e taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.885059] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-44c5b379-bd5b-44a8-ad31-bc9a9b51d60e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.885059] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-44c5b379-bd5b-44a8-ad31-bc9a9b51d60e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.885570] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-44c5b379-bd5b-44a8-ad31-bc9a9b51d60e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.885570] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.885717] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.885804] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.885978] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.886085] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.886211] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-44c5b379-bd5b-44a8-ad31-bc9a9b51d60e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.886448] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-44c5b379-bd5b-44a8-ad31-bc9a9b51d60e taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.886448] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-44c5b379-bd5b-44a8-ad31-bc9a9b51d60e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.886608] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-44c5b379-bd5b-44a8-ad31-bc9a9b51d60e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.886685] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-44c5b379-bd5b-44a8-ad31-bc9a9b51d60e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.886797] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.886893] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.886954] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.887130] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.887229] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.887285] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-44c5b379-bd5b-44a8-ad31-bc9a9b51d60e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.887405] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('44c5b379-bd5b-44a8-ad31-bc9a9b51d60e',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.110254] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('199db626-eef5-4a20-b92a-585841c1cff4',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.111407] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-199db626-eef5-4a20-b92a-585841c1cff4 taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.111573] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-199db626-eef5-4a20-b92a-585841c1cff4" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.111691] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fd6a5cb9-91c7-48a9-a002-6504eb2b96d9 with status ACTIVE [ 798.111903] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.112027] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.112099] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.112547] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.112547] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.112547] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.112709] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.112709] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.112840] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.112916] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.113114] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.113586] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.113586] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.113586] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.113586] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.113586] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fd6a5cb9-91c7-48a9-a002-6504eb2b96d9 is going to be updated. [ 798.133957] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.133957] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.133957] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.133957] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.133957] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.133957] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fd6a5cb9-91c7-48a9-a002-6504eb2b96d9" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.150818] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-d7156740-676b-417b-9850-f10d741c20bd taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.150990] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d7156740-676b-417b-9850-f10d741c20bd" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.151175] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d7156740-676b-417b-9850-f10d741c20bd',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.389680] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 44c5b379-bd5b-44a8-ad31-bc9a9b51d60e: rpc.has_security_group_logging(os_id): False [ 798.406016] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.406256] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.406357] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.406780] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.406933] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.407181] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.407378] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.407537] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.407744] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.407844] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.408069] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.408251] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.408371] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.408544] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.408632] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.408863] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.410045] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.410045] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.410045] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.410045] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.410045] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 44c5b379-bd5b-44a8-ad31-bc9a9b51d60e is going to be created. [ 798.459900] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.460096] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.460152] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.460382] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.460625] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.471542] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 44c5b379-bd5b-44a8-ad31-bc9a9b51d60e in Status: IN_PROGRESS for 2s [ 798.616130] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('199db626-eef5-4a20-b92a-585841c1cff4',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.654188] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d7156740-676b-417b-9850-f10d741c20bd',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.087319] env[69188]: INFO networking_nsxv3.common.synchronization [req-dcd887fe-6326-4510-94bb-29e90da24cbd req-18408c36-1a94-4216-a6af-7c75fb68077d tempest-ServerRescueTestJSON-1501419910 tempest-ServerRescueTestJSON-1501419910-project-member] Enqueued Resource ID: 143fbb10-efe2-4f17-a012-d41cc9b595b6 with Priority: HIGHEST for action security_group_members [ 799.088470] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 143fbb10-efe2-4f17-a012-d41cc9b595b6 with Priority: HIGHEST for action security_group_members [ 799.088470] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-143fbb10-efe2-4f17-a012-d41cc9b595b6 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.088470] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-143fbb10-efe2-4f17-a012-d41cc9b595b6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.088470] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-143fbb10-efe2-4f17-a012-d41cc9b595b6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.088738] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-143fbb10-efe2-4f17-a012-d41cc9b595b6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.088772] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.088855] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.088918] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.091898] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.092060] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.092195] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('143fbb10-efe2-4f17-a012-d41cc9b595b6',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.121917] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.122317] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.122468] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.122707] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.122822] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.123057] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 199db626-eef5-4a20-b92a-585841c1cff4 is going to be created. [ 799.145731] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.145975] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.146062] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.146273] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.146435] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.154919] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 199db626-eef5-4a20-b92a-585841c1cff4 in Status: UNINITIALIZED for 2s [ 799.158463] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.158639] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.158717] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.158927] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.159037] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.159131] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d7156740-676b-417b-9850-f10d741c20bd is going to be updated. [ 799.185998] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.186222] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.186322] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.186589] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.186783] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.195784] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d7156740-676b-417b-9850-f10d741c20bd in Status: IN_PROGRESS for 2s [ 799.571222] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock network-657 taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.571637] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "network-657" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.574936] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "network-657" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.574936] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "network-657" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.574936] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.574936] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.574936] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.574936] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.574936] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.575850] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 799.575850] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] NeedRegenerationException {{(pid=69188) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 799.575850] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] no value, waiting for create lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 799.576063] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] value creation lock acquired {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 799.576324] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 799.576568] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Calling creation function for not-yet-present value {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 799.576834] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 799.597491] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('143fbb10-efe2-4f17-a012-d41cc9b595b6',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.606694] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 799.606694] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=69188) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 799.606694] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Released creation lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 799.606694] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "network-657" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.606694] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock port-0f2ca4f4-30a4-42c2-8dc9-346fb3d530b0 taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.606694] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "port-0f2ca4f4-30a4-42c2-8dc9-346fb3d530b0" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.606694] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "port-0f2ca4f4-30a4-42c2-8dc9-346fb3d530b0" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.606694] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "port-0f2ca4f4-30a4-42c2-8dc9-346fb3d530b0" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.607443] env[69188]: DEBUG networking_nsxv3.api.rpc [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0f2ca4f4-30a4-42c2-8dc9-346fb3d530b0',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.099661] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('143fbb10-efe2-4f17-a012-d41cc9b595b6',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.110830] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.110830] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.110830] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.110830] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.110830] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.110830] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Segment Port 0f2ca4f4-30a4-42c2-8dc9-346fb3d530b0 not found, creating... [ 800.111318] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.111640] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.111818] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.112355] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.113499] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.113499] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.113499] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.113499] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.114114] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.114114] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.114469] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Resource: SegmentPort with ID: 0f2ca4f4-30a4-42c2-8dc9-346fb3d530b0 is going to be created. [ 800.139693] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.139693] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.139693] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.139693] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.139693] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.139693] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "port-0f2ca4f4-30a4-42c2-8dc9-346fb3d530b0" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.209844] env[69188]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-ca0141f8-e0d0-45bb-94d3-6579b85b932c None None] NSXv3 Agent Agent loop - iteration:0 completed [ 800.210020] env[69188]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-ca0141f8-e0d0-45bb-94d3-6579b85b932c None None] NSXv3 Agent Agent loop - iteration:1 started [ 800.483810] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 44c5b379-bd5b-44a8-ad31-bc9a9b51d60e in Status: SUCCESS [ 800.483810] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-44c5b379-bd5b-44a8-ad31-bc9a9b51d60e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.602841] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.602841] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.602841] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.603274] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.603274] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.603274] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 143fbb10-efe2-4f17-a012-d41cc9b595b6 is going to be updated. [ 800.627793] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.627945] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.628011] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.628288] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.628352] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.636597] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 143fbb10-efe2-4f17-a012-d41cc9b595b6 in Status: IN_PROGRESS for 2s [ 800.941260] env[69188]: INFO networking_nsxv3.common.synchronization [req-dcd887fe-6326-4510-94bb-29e90da24cbd req-9339552a-b36a-4c37-a212-c1745afd18dd service nova] Enqueued Resource ID: 143fbb10-efe2-4f17-a012-d41cc9b595b6 with Priority: HIGHEST for action security_group_rules [ 800.941450] env[69188]: INFO networking_nsxv3.common.synchronization [req-dcd887fe-6326-4510-94bb-29e90da24cbd req-9339552a-b36a-4c37-a212-c1745afd18dd service nova] Enqueued Resource ID: 143fbb10-efe2-4f17-a012-d41cc9b595b6 with Priority: HIGHEST for action security_group_members [ 800.941617] env[69188]: INFO networking_nsxv3.common.synchronization [req-dcd887fe-6326-4510-94bb-29e90da24cbd req-9339552a-b36a-4c37-a212-c1745afd18dd service nova] Enqueued Resource ID: 0f2ca4f4-30a4-42c2-8dc9-346fb3d530b0 with Priority: HIGHEST for action port [ 800.941856] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 143fbb10-efe2-4f17-a012-d41cc9b595b6 with Priority: HIGHEST for action security_group_rules [ 800.941997] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 143fbb10-efe2-4f17-a012-d41cc9b595b6 with Priority: HIGHEST for action security_group_members [ 800.942109] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0f2ca4f4-30a4-42c2-8dc9-346fb3d530b0 with Priority: HIGHEST for action port [ 800.942694] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-143fbb10-efe2-4f17-a012-d41cc9b595b6 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.942787] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-143fbb10-efe2-4f17-a012-d41cc9b595b6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.942850] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-143fbb10-efe2-4f17-a012-d41cc9b595b6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.943494] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-143fbb10-efe2-4f17-a012-d41cc9b595b6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.943611] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('143fbb10-efe2-4f17-a012-d41cc9b595b6',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.944775] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-143fbb10-efe2-4f17-a012-d41cc9b595b6 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.944884] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-143fbb10-efe2-4f17-a012-d41cc9b595b6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.945135] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-0f2ca4f4-30a4-42c2-8dc9-346fb3d530b0 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.945203] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0f2ca4f4-30a4-42c2-8dc9-346fb3d530b0" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.945260] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0f2ca4f4-30a4-42c2-8dc9-346fb3d530b0" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.945699] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0f2ca4f4-30a4-42c2-8dc9-346fb3d530b0" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.945699] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0f2ca4f4-30a4-42c2-8dc9-346fb3d530b0',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.166876] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 199db626-eef5-4a20-b92a-585841c1cff4 in Status: SUCCESS [ 801.167519] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-199db626-eef5-4a20-b92a-585841c1cff4" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.167754] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-199db626-eef5-4a20-b92a-585841c1cff4" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.168006] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-199db626-eef5-4a20-b92a-585841c1cff4" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.168242] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.168371] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.168474] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.168661] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.168762] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.168860] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-199db626-eef5-4a20-b92a-585841c1cff4" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.168987] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('199db626-eef5-4a20-b92a-585841c1cff4',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.204606] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d7156740-676b-417b-9850-f10d741c20bd in Status: SUCCESS [ 801.204830] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d7156740-676b-417b-9850-f10d741c20bd" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.204978] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d7156740-676b-417b-9850-f10d741c20bd" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.205219] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d7156740-676b-417b-9850-f10d741c20bd" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.205391] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.205535] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.205604] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.205759] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.205841] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.205935] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d7156740-676b-417b-9850-f10d741c20bd',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.447410] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-143fbb10-efe2-4f17-a012-d41cc9b595b6 taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.447410] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-143fbb10-efe2-4f17-a012-d41cc9b595b6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.449439] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0f2ca4f4-30a4-42c2-8dc9-346fb3d530b0 with status ACTIVE [ 801.449439] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.449439] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.449439] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.449439] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.449772] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.449772] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.449772] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.449865] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.450043] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.450135] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.450265] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.450357] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.450408] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.450549] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.450622] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.450705] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0f2ca4f4-30a4-42c2-8dc9-346fb3d530b0 is going to be updated. [ 801.471603] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.471784] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.471784] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.471987] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.472066] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.472346] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0f2ca4f4-30a4-42c2-8dc9-346fb3d530b0" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.672161] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-199db626-eef5-4a20-b92a-585841c1cff4 taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.672161] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-199db626-eef5-4a20-b92a-585841c1cff4" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.672161] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-199db626-eef5-4a20-b92a-585841c1cff4" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.672161] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-199db626-eef5-4a20-b92a-585841c1cff4" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.672161] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.672161] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.672161] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.672161] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.672772] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.672772] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-199db626-eef5-4a20-b92a-585841c1cff4" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.674229] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-199db626-eef5-4a20-b92a-585841c1cff4 taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.674229] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-199db626-eef5-4a20-b92a-585841c1cff4" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.674229] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-199db626-eef5-4a20-b92a-585841c1cff4" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.674229] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-199db626-eef5-4a20-b92a-585841c1cff4" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.674229] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.674229] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.674229] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.674229] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.675138] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.675138] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-199db626-eef5-4a20-b92a-585841c1cff4" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.675138] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('199db626-eef5-4a20-b92a-585841c1cff4',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.707883] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d7156740-676b-417b-9850-f10d741c20bd',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.182449] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 199db626-eef5-4a20-b92a-585841c1cff4: rpc.has_security_group_logging(os_id): False [ 802.201381] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.201570] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.201620] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.201839] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.201973] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.202163] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.202258] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.202322] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.202489] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.202602] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.202899] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.203024] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.203088] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.203211] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.203292] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.203480] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.203621] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.203712] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.203828] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.203910] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.204485] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 199db626-eef5-4a20-b92a-585841c1cff4 is going to be created. [ 802.209810] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d7156740-676b-417b-9850-f10d741c20bd',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.255782] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.255977] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.255977] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.256225] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.256437] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.266916] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 199db626-eef5-4a20-b92a-585841c1cff4 in Status: IN_PROGRESS for 2s [ 802.646796] env[69188]: INFO networking_nsxv3.common.synchronization [req-0a410030-089d-4d00-87fa-ffe17d681a52 req-de4797ee-62b9-4507-9c9f-5cfdeab940e4 tempest-ServersV294TestFqdnHostnames-1833622075 tempest-ServersV294TestFqdnHostnames-1833622075-project-member] Enqueued Resource ID: 2dad819d-4da9-4798-827e-298c399b35c5 with Priority: HIGHEST for action security_group_members [ 802.647766] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 143fbb10-efe2-4f17-a012-d41cc9b595b6 in Status: SUCCESS [ 802.648419] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-143fbb10-efe2-4f17-a012-d41cc9b595b6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.649771] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2dad819d-4da9-4798-827e-298c399b35c5 with Priority: HIGHEST for action security_group_members [ 802.650068] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-143fbb10-efe2-4f17-a012-d41cc9b595b6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.650325] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-143fbb10-efe2-4f17-a012-d41cc9b595b6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.650513] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.650648] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.650731] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.650904] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.651024] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.651141] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('143fbb10-efe2-4f17-a012-d41cc9b595b6',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.652592] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-2dad819d-4da9-4798-827e-298c399b35c5 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.652763] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2dad819d-4da9-4798-827e-298c399b35c5" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.652814] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2dad819d-4da9-4798-827e-298c399b35c5" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.653048] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2dad819d-4da9-4798-827e-298c399b35c5" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.653271] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.653360] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.653441] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.653646] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.653735] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.653842] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2dad819d-4da9-4798-827e-298c399b35c5',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.713194] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.713194] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.713194] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.713194] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.713194] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.713194] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d7156740-676b-417b-9850-f10d741c20bd is going to be updated. [ 802.756018] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.756018] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.756018] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.756409] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.756583] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.772995] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d7156740-676b-417b-9850-f10d741c20bd in Status: IN_PROGRESS for 2s [ 803.058267] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock network-530 taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.058529] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "network-530" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.058729] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "network-530" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.059092] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "network-530" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.059688] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.059917] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.060529] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.060900] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.061443] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.061699] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 803.065128] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] NeedRegenerationException {{(pid=69188) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 803.065323] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] no value, waiting for create lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 803.065369] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] value creation lock acquired {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 803.065491] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 803.065598] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Calling creation function for not-yet-present value {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 803.065734] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 803.084695] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 803.085046] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69188) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 803.086538] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Released creation lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 803.086538] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "network-530" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.086538] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock port-d49d801f-b149-4008-be7c-60eb22ae1d57 taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.086538] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "port-d49d801f-b149-4008-be7c-60eb22ae1d57" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.086538] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "port-d49d801f-b149-4008-be7c-60eb22ae1d57" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.086828] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "port-d49d801f-b149-4008-be7c-60eb22ae1d57" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.086943] env[69188]: DEBUG networking_nsxv3.api.rpc [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d49d801f-b149-4008-be7c-60eb22ae1d57',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.156053] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('143fbb10-efe2-4f17-a012-d41cc9b595b6',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.156373] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.156540] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.156540] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.160045] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.160045] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.160045] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.160045] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.160045] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.160045] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.160045] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.160045] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2dad819d-4da9-4798-827e-298c399b35c5 already deleted. [ 803.160045] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2dad819d-4da9-4798-827e-298c399b35c5" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.591174] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.591174] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.591174] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.591174] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.591174] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.591174] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Segment Port d49d801f-b149-4008-be7c-60eb22ae1d57 not found, creating... [ 803.591174] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.591174] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.591506] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.591538] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.591695] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.592034] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.592290] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.592356] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.592591] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.592742] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.592911] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Resource: SegmentPort with ID: d49d801f-b149-4008-be7c-60eb22ae1d57 is going to be created. [ 803.611824] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.612107] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.612264] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.612576] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.612835] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.613116] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "port-d49d801f-b149-4008-be7c-60eb22ae1d57" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.655837] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('143fbb10-efe2-4f17-a012-d41cc9b595b6',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.161748] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.161748] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.161748] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.162095] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.162095] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.162095] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 143fbb10-efe2-4f17-a012-d41cc9b595b6 is going to be updated. [ 804.193273] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.193273] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.193273] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.193591] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.193591] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.207027] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 143fbb10-efe2-4f17-a012-d41cc9b595b6 in Status: IN_PROGRESS for 2s [ 804.279088] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 199db626-eef5-4a20-b92a-585841c1cff4 in Status: SUCCESS [ 804.279377] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-199db626-eef5-4a20-b92a-585841c1cff4" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.285587] env[69188]: INFO networking_nsxv3.common.synchronization [None req-4989830b-5a5c-441e-a2bb-f610cb398527 None None] Enqueued Resource ID: 127f64d8-35d4-4bdb-abe1-2973b13c3665 with Priority: HIGHEST for action port [ 804.285587] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 127f64d8-35d4-4bdb-abe1-2973b13c3665 with Priority: HIGHEST for action port [ 804.285587] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-127f64d8-35d4-4bdb-abe1-2973b13c3665 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.285587] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-127f64d8-35d4-4bdb-abe1-2973b13c3665" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.286300] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-127f64d8-35d4-4bdb-abe1-2973b13c3665" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.286601] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-127f64d8-35d4-4bdb-abe1-2973b13c3665" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.286683] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('127f64d8-35d4-4bdb-abe1-2973b13c3665',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.314022] env[69188]: INFO networking_nsxv3.common.synchronization [req-0a410030-089d-4d00-87fa-ffe17d681a52 req-82862155-db1d-4e4e-b40a-2e0ea7e093e1 service nova] Enqueued Resource ID: 2dad819d-4da9-4798-827e-298c399b35c5 with Priority: HIGHEST for action security_group_rules [ 804.314250] env[69188]: INFO networking_nsxv3.common.synchronization [req-0a410030-089d-4d00-87fa-ffe17d681a52 req-82862155-db1d-4e4e-b40a-2e0ea7e093e1 service nova] Enqueued Resource ID: 2dad819d-4da9-4798-827e-298c399b35c5 with Priority: HIGHEST for action security_group_members [ 804.314437] env[69188]: INFO networking_nsxv3.common.synchronization [req-0a410030-089d-4d00-87fa-ffe17d681a52 req-82862155-db1d-4e4e-b40a-2e0ea7e093e1 service nova] Enqueued Resource ID: d49d801f-b149-4008-be7c-60eb22ae1d57 with Priority: HIGHEST for action port [ 804.314682] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2dad819d-4da9-4798-827e-298c399b35c5 with Priority: HIGHEST for action security_group_rules [ 804.314824] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2dad819d-4da9-4798-827e-298c399b35c5 with Priority: HIGHEST for action security_group_members [ 804.314946] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d49d801f-b149-4008-be7c-60eb22ae1d57 with Priority: HIGHEST for action port [ 804.315790] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2dad819d-4da9-4798-827e-298c399b35c5 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.315868] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2dad819d-4da9-4798-827e-298c399b35c5" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.315945] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2dad819d-4da9-4798-827e-298c399b35c5" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.316386] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2dad819d-4da9-4798-827e-298c399b35c5" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.316641] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2dad819d-4da9-4798-827e-298c399b35c5',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.320874] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-2dad819d-4da9-4798-827e-298c399b35c5 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.320874] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2dad819d-4da9-4798-827e-298c399b35c5" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.320874] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2dad819d-4da9-4798-827e-298c399b35c5" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.320874] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2dad819d-4da9-4798-827e-298c399b35c5" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.320874] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.320874] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.320874] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.320874] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.320874] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.320874] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2dad819d-4da9-4798-827e-298c399b35c5',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.321720] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-d49d801f-b149-4008-be7c-60eb22ae1d57 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.321720] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d49d801f-b149-4008-be7c-60eb22ae1d57" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.321720] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d49d801f-b149-4008-be7c-60eb22ae1d57" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.321720] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d49d801f-b149-4008-be7c-60eb22ae1d57" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.321720] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d49d801f-b149-4008-be7c-60eb22ae1d57',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.784464] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d7156740-676b-417b-9850-f10d741c20bd in Status: SUCCESS [ 804.784699] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d7156740-676b-417b-9850-f10d741c20bd" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.784866] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d7156740-676b-417b-9850-f10d741c20bd" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.785100] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d7156740-676b-417b-9850-f10d741c20bd" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.785299] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.785416] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.785487] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.785653] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.785734] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.785817] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d7156740-676b-417b-9850-f10d741c20bd" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.785964] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-d7156740-676b-417b-9850-f10d741c20bd taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.786069] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d7156740-676b-417b-9850-f10d741c20bd" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.786155] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d7156740-676b-417b-9850-f10d741c20bd" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.786259] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d7156740-676b-417b-9850-f10d741c20bd" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.786430] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.786479] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.786528] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.786654] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.786723] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.786796] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d7156740-676b-417b-9850-f10d741c20bd" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.786882] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d7156740-676b-417b-9850-f10d741c20bd',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.789316] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 127f64d8-35d4-4bdb-abe1-2973b13c3665 [ 804.791016] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.791222] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.791276] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.791422] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.791502] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.791600] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:127f64d8-35d4-4bdb-abe1-2973b13c3665 already deleted. [ 804.791665] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-127f64d8-35d4-4bdb-abe1-2973b13c3665" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.825015] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-2dad819d-4da9-4798-827e-298c399b35c5 taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.825153] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2dad819d-4da9-4798-827e-298c399b35c5" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.827851] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2dad819d-4da9-4798-827e-298c399b35c5',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.827995] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d49d801f-b149-4008-be7c-60eb22ae1d57 with status ACTIVE [ 804.828193] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.828315] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.828387] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.829210] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.829210] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.829210] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.829210] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.829210] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.829210] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.829533] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.829533] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.829533] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.829675] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.829675] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.829751] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.829817] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d49d801f-b149-4008-be7c-60eb22ae1d57 is going to be updated. [ 804.851025] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.851025] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.851025] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.851025] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.851025] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.851025] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d49d801f-b149-4008-be7c-60eb22ae1d57" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.201213] env[69188]: INFO networking_nsxv3.common.synchronization [req-4334f889-2463-49cf-baad-346e28e271a3 req-ae6d7ef3-c4ae-413c-b878-1f58088d3900 tempest-ImagesOneServerNegativeTestJSON-1186419322 tempest-ImagesOneServerNegativeTestJSON-1186419322-project-member] Enqueued Resource ID: 9d153fe4-605f-47fe-a33b-9d019b977fa7 with Priority: HIGHEST for action security_group_members [ 805.201721] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9d153fe4-605f-47fe-a33b-9d019b977fa7 with Priority: HIGHEST for action security_group_members [ 805.201974] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-9d153fe4-605f-47fe-a33b-9d019b977fa7 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.202111] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9d153fe4-605f-47fe-a33b-9d019b977fa7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.202184] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9d153fe4-605f-47fe-a33b-9d019b977fa7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.202531] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9d153fe4-605f-47fe-a33b-9d019b977fa7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.202531] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.202726] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.202726] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.202977] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.202977] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.202977] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9d153fe4-605f-47fe-a33b-9d019b977fa7',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.293240] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d7156740-676b-417b-9850-f10d741c20bd: rpc.has_security_group_logging(os_id): False [ 805.314021] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.314021] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.314021] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.314021] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.314021] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.314021] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.314021] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.314021] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.314021] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.314021] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.314021] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.314021] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.314021] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.314021] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.314021] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.314725] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.314725] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.314725] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.314725] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.314725] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.314725] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d7156740-676b-417b-9850-f10d741c20bd is going to be created. [ 805.332365] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2dad819d-4da9-4798-827e-298c399b35c5',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.372265] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.372265] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.372265] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.372265] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.372265] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.380778] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d7156740-676b-417b-9850-f10d741c20bd in Status: IN_PROGRESS for 2s [ 805.609859] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock network-791 taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.613782] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "network-791" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.613782] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "network-791" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.613782] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "network-791" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.613782] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.613782] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.613782] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.613782] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.613782] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.613782] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 805.613782] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] NeedRegenerationException {{(pid=69188) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 805.613782] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] no value, waiting for create lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 805.613782] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] value creation lock acquired {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 805.613782] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 805.613782] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Calling creation function for not-yet-present value {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 805.613782] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 805.630730] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 805.630820] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69188) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 805.630959] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Released creation lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 805.631178] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "network-791" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.631489] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock port-39262693-bede-4cdf-ba51-bb2db87b9799 taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.631658] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "port-39262693-bede-4cdf-ba51-bb2db87b9799" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.631778] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "port-39262693-bede-4cdf-ba51-bb2db87b9799" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.632125] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "port-39262693-bede-4cdf-ba51-bb2db87b9799" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.632230] env[69188]: DEBUG networking_nsxv3.api.rpc [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('39262693-bede-4cdf-ba51-bb2db87b9799',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.705283] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.705403] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.705550] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.706304] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.706415] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.706622] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.706728] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.706793] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.706945] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.707044] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.707132] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9d153fe4-605f-47fe-a33b-9d019b977fa7 is going to be updated. [ 805.763338] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.763544] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.763642] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.764104] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.764104] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.788812] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9d153fe4-605f-47fe-a33b-9d019b977fa7 in Status: IN_PROGRESS for 2s [ 805.837053] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.837053] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.837053] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.837053] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.837053] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.837053] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2dad819d-4da9-4798-827e-298c399b35c5 is going to be created. [ 805.858615] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.858751] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.858816] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.859031] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.859194] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.868410] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2dad819d-4da9-4798-827e-298c399b35c5 in Status: UNINITIALIZED for 2s [ 806.135648] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.135648] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.135926] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.136536] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.136536] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.136536] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Segment Port 39262693-bede-4cdf-ba51-bb2db87b9799 not found, creating... [ 806.136850] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.137079] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.137210] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.137455] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.137874] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.138112] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.138185] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.138281] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.138469] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.138610] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.138848] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Resource: SegmentPort with ID: 39262693-bede-4cdf-ba51-bb2db87b9799 is going to be created. [ 806.161934] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.161934] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.161934] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.162215] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.162215] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.162538] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "port-39262693-bede-4cdf-ba51-bb2db87b9799" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.215807] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 143fbb10-efe2-4f17-a012-d41cc9b595b6 in Status: SUCCESS [ 806.216212] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-143fbb10-efe2-4f17-a012-d41cc9b595b6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.216369] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-143fbb10-efe2-4f17-a012-d41cc9b595b6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.216649] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-143fbb10-efe2-4f17-a012-d41cc9b595b6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.218115] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.218115] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.218115] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.218115] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.218115] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.218115] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-143fbb10-efe2-4f17-a012-d41cc9b595b6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.218115] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('143fbb10-efe2-4f17-a012-d41cc9b595b6',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.723808] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-143fbb10-efe2-4f17-a012-d41cc9b595b6 taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.723987] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-143fbb10-efe2-4f17-a012-d41cc9b595b6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.723987] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-143fbb10-efe2-4f17-a012-d41cc9b595b6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.724228] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-143fbb10-efe2-4f17-a012-d41cc9b595b6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.724401] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.724509] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.724737] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.724737] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.724901] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.724901] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-143fbb10-efe2-4f17-a012-d41cc9b595b6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.725110] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-143fbb10-efe2-4f17-a012-d41cc9b595b6 taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.725197] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-143fbb10-efe2-4f17-a012-d41cc9b595b6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.725261] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-143fbb10-efe2-4f17-a012-d41cc9b595b6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.725408] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-143fbb10-efe2-4f17-a012-d41cc9b595b6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.725543] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.725634] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.725697] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.725833] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.725910] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.725991] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-143fbb10-efe2-4f17-a012-d41cc9b595b6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.726089] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('143fbb10-efe2-4f17-a012-d41cc9b595b6',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.784695] env[69188]: INFO networking_nsxv3.common.synchronization [None req-15353491-cf09-4125-8c88-8c40b250efcc None None] Enqueued Resource ID: 8ea4885b-bff5-42ff-b0f4-ec2396ab6fca with Priority: HIGHEST for action port [ 806.784695] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8ea4885b-bff5-42ff-b0f4-ec2396ab6fca with Priority: HIGHEST for action port [ 806.784695] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-8ea4885b-bff5-42ff-b0f4-ec2396ab6fca taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.784695] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8ea4885b-bff5-42ff-b0f4-ec2396ab6fca" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.785133] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8ea4885b-bff5-42ff-b0f4-ec2396ab6fca" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.785805] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8ea4885b-bff5-42ff-b0f4-ec2396ab6fca" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.786141] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8ea4885b-bff5-42ff-b0f4-ec2396ab6fca',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.916184] env[69188]: INFO networking_nsxv3.common.synchronization [req-4334f889-2463-49cf-baad-346e28e271a3 req-573a1c77-c880-4631-901b-db3d617899b5 service nova] Enqueued Resource ID: 9d153fe4-605f-47fe-a33b-9d019b977fa7 with Priority: HIGHEST for action security_group_rules [ 806.916184] env[69188]: INFO networking_nsxv3.common.synchronization [req-4334f889-2463-49cf-baad-346e28e271a3 req-573a1c77-c880-4631-901b-db3d617899b5 service nova] Enqueued Resource ID: 9d153fe4-605f-47fe-a33b-9d019b977fa7 with Priority: HIGHEST for action security_group_members [ 806.916184] env[69188]: INFO networking_nsxv3.common.synchronization [req-4334f889-2463-49cf-baad-346e28e271a3 req-573a1c77-c880-4631-901b-db3d617899b5 service nova] Enqueued Resource ID: 39262693-bede-4cdf-ba51-bb2db87b9799 with Priority: HIGHEST for action port [ 806.916184] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9d153fe4-605f-47fe-a33b-9d019b977fa7 with Priority: HIGHEST for action security_group_rules [ 806.916184] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9d153fe4-605f-47fe-a33b-9d019b977fa7 with Priority: HIGHEST for action security_group_members [ 806.916184] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 39262693-bede-4cdf-ba51-bb2db87b9799 with Priority: HIGHEST for action port [ 806.916184] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9d153fe4-605f-47fe-a33b-9d019b977fa7 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.916184] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9d153fe4-605f-47fe-a33b-9d019b977fa7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.916184] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9d153fe4-605f-47fe-a33b-9d019b977fa7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.916184] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9d153fe4-605f-47fe-a33b-9d019b977fa7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.916184] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9d153fe4-605f-47fe-a33b-9d019b977fa7',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.917192] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-9d153fe4-605f-47fe-a33b-9d019b977fa7 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.917398] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9d153fe4-605f-47fe-a33b-9d019b977fa7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.917632] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-39262693-bede-4cdf-ba51-bb2db87b9799 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.917743] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-39262693-bede-4cdf-ba51-bb2db87b9799" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.917809] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-39262693-bede-4cdf-ba51-bb2db87b9799" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.917987] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-39262693-bede-4cdf-ba51-bb2db87b9799" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.918071] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('39262693-bede-4cdf-ba51-bb2db87b9799',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.228310] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 143fbb10-efe2-4f17-a012-d41cc9b595b6: rpc.has_security_group_logging(os_id): False [ 807.245014] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.245206] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.245262] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.245483] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.245582] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.245806] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.245859] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.245921] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.246071] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.246152] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.246364] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.247102] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.247102] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.247102] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.247102] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.247102] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.247508] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.247718] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.247852] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.247934] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.248043] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 143fbb10-efe2-4f17-a012-d41cc9b595b6 is going to be updated. [ 807.290267] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8ea4885b-bff5-42ff-b0f4-ec2396ab6fca [ 807.290500] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.290639] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.290706] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.290954] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.291063] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.291151] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8ea4885b-bff5-42ff-b0f4-ec2396ab6fca already deleted. [ 807.291228] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8ea4885b-bff5-42ff-b0f4-ec2396ab6fca" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.309706] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.310186] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.310186] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.310296] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.310477] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.324694] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 143fbb10-efe2-4f17-a012-d41cc9b595b6 in Status: IN_PROGRESS for 2s [ 807.408410] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d7156740-676b-417b-9850-f10d741c20bd in Status: SUCCESS [ 807.408734] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d7156740-676b-417b-9850-f10d741c20bd" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.408977] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d7156740-676b-417b-9850-f10d741c20bd" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.409240] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d7156740-676b-417b-9850-f10d741c20bd" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.409361] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d7156740-676b-417b-9850-f10d741c20bd',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.418089] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-9d153fe4-605f-47fe-a33b-9d019b977fa7 taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.418226] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9d153fe4-605f-47fe-a33b-9d019b977fa7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.419539] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 39262693-bede-4cdf-ba51-bb2db87b9799 with status ACTIVE [ 807.419719] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.419834] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.419902] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.420112] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.420202] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.420367] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.420463] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.420523] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.420678] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.420754] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.420973] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.421098] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.421160] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.421302] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.421378] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.421462] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 39262693-bede-4cdf-ba51-bb2db87b9799 is going to be updated. [ 807.442042] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.442153] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.442217] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.442412] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.442549] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.442702] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-39262693-bede-4cdf-ba51-bb2db87b9799" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.799746] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9d153fe4-605f-47fe-a33b-9d019b977fa7 in Status: SUCCESS [ 807.800007] env[69188]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9d153fe4-605f-47fe-a33b-9d019b977fa7 deletion is rescheduled due to dependency. [ 807.800186] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9d153fe4-605f-47fe-a33b-9d019b977fa7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.800418] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9d153fe4-605f-47fe-a33b-9d019b977fa7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.800689] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9d153fe4-605f-47fe-a33b-9d019b977fa7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.800930] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.801073] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.801145] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.801369] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.801412] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.801486] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9d153fe4-605f-47fe-a33b-9d019b977fa7',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.879272] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2dad819d-4da9-4798-827e-298c399b35c5 in Status: SUCCESS [ 807.879488] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2dad819d-4da9-4798-827e-298c399b35c5" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.879654] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2dad819d-4da9-4798-827e-298c399b35c5" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.879868] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2dad819d-4da9-4798-827e-298c399b35c5" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.880158] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.880298] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.880367] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.880525] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.880611] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.880698] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2dad819d-4da9-4798-827e-298c399b35c5" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.880792] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2dad819d-4da9-4798-827e-298c399b35c5',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.911708] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-d7156740-676b-417b-9850-f10d741c20bd taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.911864] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d7156740-676b-417b-9850-f10d741c20bd" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.911937] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d7156740-676b-417b-9850-f10d741c20bd" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.912227] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d7156740-676b-417b-9850-f10d741c20bd" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.912408] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.912514] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.912579] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.912734] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.912823] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.912910] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d7156740-676b-417b-9850-f10d741c20bd" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.913008] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d7156740-676b-417b-9850-f10d741c20bd',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.310791] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9d153fe4-605f-47fe-a33b-9d019b977fa7',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.384240] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2dad819d-4da9-4798-827e-298c399b35c5',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.418900] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-d7156740-676b-417b-9850-f10d741c20bd taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.419766] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d7156740-676b-417b-9850-f10d741c20bd" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.419987] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d7156740-676b-417b-9850-f10d741c20bd" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.420347] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d7156740-676b-417b-9850-f10d741c20bd" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.422938] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.422938] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.422938] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.422938] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.422938] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.422938] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d7156740-676b-417b-9850-f10d741c20bd" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.422938] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-d7156740-676b-417b-9850-f10d741c20bd taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.422938] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d7156740-676b-417b-9850-f10d741c20bd" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.422938] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d7156740-676b-417b-9850-f10d741c20bd" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.422938] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d7156740-676b-417b-9850-f10d741c20bd" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.422938] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.422938] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.422938] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.422938] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.422938] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.422938] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d7156740-676b-417b-9850-f10d741c20bd" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.422938] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d7156740-676b-417b-9850-f10d741c20bd',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.815830] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9d153fe4-605f-47fe-a33b-9d019b977fa7',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.885978] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2dad819d-4da9-4798-827e-298c399b35c5: rpc.has_security_group_logging(os_id): False [ 808.904217] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.904368] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.904434] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.904653] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.904773] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.905109] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.905186] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.905219] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.905358] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.905444] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.905550] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2dad819d-4da9-4798-827e-298c399b35c5 is going to be created. [ 808.929283] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d7156740-676b-417b-9850-f10d741c20bd: rpc.has_security_group_logging(os_id): False [ 808.952022] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.952022] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.952022] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.952022] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.952022] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.952442] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.952533] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.952715] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.952939] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.953093] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.953554] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.953694] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.953793] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.953995] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.955186] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.955186] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.955186] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.955186] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.955186] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.955186] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.955186] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d7156740-676b-417b-9850-f10d741c20bd is going to be updated. [ 808.961862] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.962077] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.962190] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.962419] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.962639] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.972102] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2dad819d-4da9-4798-827e-298c399b35c5 in Status: IN_PROGRESS for 2s [ 809.020409] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.020549] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.020834] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.020834] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.020967] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.051175] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d7156740-676b-417b-9850-f10d741c20bd in Status: IN_PROGRESS for 2s [ 809.325914] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.325914] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.325914] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.325914] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.325914] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.325914] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9d153fe4-605f-47fe-a33b-9d019b977fa7 is going to be updated. [ 809.341516] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 143fbb10-efe2-4f17-a012-d41cc9b595b6 in Status: SUCCESS [ 809.341516] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-143fbb10-efe2-4f17-a012-d41cc9b595b6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.355391] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.355553] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.355709] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.355928] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.356116] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.366932] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9d153fe4-605f-47fe-a33b-9d019b977fa7 in Status: IN_PROGRESS for 2s [ 809.371230] env[69188]: INFO networking_nsxv3.common.synchronization [req-904ce4d8-2603-4af2-a8ae-d8f4df4abad0 req-bbe46ecc-0fcc-4c4e-af9c-79b519a9ab83 tempest-ServerGroupTestJSON-1011282019 tempest-ServerGroupTestJSON-1011282019-project-member] Enqueued Resource ID: c1b8ce61-c092-47d3-9c53-192ccca5ff8d with Priority: HIGHEST for action security_group_members [ 809.371854] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c1b8ce61-c092-47d3-9c53-192ccca5ff8d with Priority: HIGHEST for action security_group_members [ 809.372879] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-c1b8ce61-c092-47d3-9c53-192ccca5ff8d taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.373041] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c1b8ce61-c092-47d3-9c53-192ccca5ff8d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.373115] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c1b8ce61-c092-47d3-9c53-192ccca5ff8d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.373371] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c1b8ce61-c092-47d3-9c53-192ccca5ff8d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.373545] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.373652] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.373719] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.373878] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.373969] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.374077] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c1b8ce61-c092-47d3-9c53-192ccca5ff8d',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.842316] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock network-35 taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.842763] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "network-35" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.842763] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "network-35" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.843071] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "network-35" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.843278] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.843729] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.843729] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.843866] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.843914] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.844142] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 809.844387] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] NeedRegenerationException {{(pid=69188) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 809.844442] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] no value, waiting for create lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 809.844834] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] value creation lock acquired {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 809.844834] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 809.844834] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Calling creation function for not-yet-present value {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 809.844962] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 809.861470] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 809.861650] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=69188) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 809.862469] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Released creation lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 809.862469] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "network-35" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.862469] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock port-08deede4-9aa7-42dc-ade6-53013d0766b2 taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.862469] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "port-08deede4-9aa7-42dc-ade6-53013d0766b2" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.862758] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "port-08deede4-9aa7-42dc-ade6-53013d0766b2" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.862914] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "port-08deede4-9aa7-42dc-ade6-53013d0766b2" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.863069] env[69188]: DEBUG networking_nsxv3.api.rpc [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('08deede4-9aa7-42dc-ade6-53013d0766b2',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.876367] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.876505] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.876570] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.876833] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.876936] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.877216] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.877347] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.877405] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.877739] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.877801] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.877893] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c1b8ce61-c092-47d3-9c53-192ccca5ff8d already deleted. [ 809.878022] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c1b8ce61-c092-47d3-9c53-192ccca5ff8d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.371353] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.371746] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.371746] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.371993] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.372172] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.372346] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Segment Port 08deede4-9aa7-42dc-ade6-53013d0766b2 not found, creating... [ 810.372594] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.372750] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.372869] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.373099] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.373238] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.373517] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.373673] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.373792] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.373989] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.375933] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.376082] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Resource: SegmentPort with ID: 08deede4-9aa7-42dc-ade6-53013d0766b2 is going to be created. [ 810.394431] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.394658] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.394800] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.395114] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.395308] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.395525] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "port-08deede4-9aa7-42dc-ade6-53013d0766b2" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.823429] env[69188]: INFO networking_nsxv3.common.synchronization [req-904ce4d8-2603-4af2-a8ae-d8f4df4abad0 req-7ace36b8-c00f-4ef7-b9c7-9a4bd0dc3fc8 service nova] Enqueued Resource ID: c1b8ce61-c092-47d3-9c53-192ccca5ff8d with Priority: HIGHEST for action security_group_rules [ 810.823429] env[69188]: INFO networking_nsxv3.common.synchronization [req-904ce4d8-2603-4af2-a8ae-d8f4df4abad0 req-7ace36b8-c00f-4ef7-b9c7-9a4bd0dc3fc8 service nova] Enqueued Resource ID: c1b8ce61-c092-47d3-9c53-192ccca5ff8d with Priority: HIGHEST for action security_group_members [ 810.826145] env[69188]: INFO networking_nsxv3.common.synchronization [req-904ce4d8-2603-4af2-a8ae-d8f4df4abad0 req-7ace36b8-c00f-4ef7-b9c7-9a4bd0dc3fc8 service nova] Enqueued Resource ID: 08deede4-9aa7-42dc-ade6-53013d0766b2 with Priority: HIGHEST for action port [ 810.826145] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c1b8ce61-c092-47d3-9c53-192ccca5ff8d with Priority: HIGHEST for action security_group_rules [ 810.826145] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c1b8ce61-c092-47d3-9c53-192ccca5ff8d with Priority: HIGHEST for action security_group_members [ 810.826145] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 08deede4-9aa7-42dc-ade6-53013d0766b2 with Priority: HIGHEST for action port [ 810.826145] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c1b8ce61-c092-47d3-9c53-192ccca5ff8d taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.826145] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c1b8ce61-c092-47d3-9c53-192ccca5ff8d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.826145] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c1b8ce61-c092-47d3-9c53-192ccca5ff8d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.826145] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c1b8ce61-c092-47d3-9c53-192ccca5ff8d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.826145] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c1b8ce61-c092-47d3-9c53-192ccca5ff8d',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.826145] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-c1b8ce61-c092-47d3-9c53-192ccca5ff8d taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.826145] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c1b8ce61-c092-47d3-9c53-192ccca5ff8d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.826145] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c1b8ce61-c092-47d3-9c53-192ccca5ff8d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.826806] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c1b8ce61-c092-47d3-9c53-192ccca5ff8d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.826806] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.826806] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.826806] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.826806] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.826806] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.826806] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c1b8ce61-c092-47d3-9c53-192ccca5ff8d',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.827957] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-08deede4-9aa7-42dc-ade6-53013d0766b2 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.827957] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-08deede4-9aa7-42dc-ade6-53013d0766b2" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.828101] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-08deede4-9aa7-42dc-ade6-53013d0766b2" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.828573] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-08deede4-9aa7-42dc-ade6-53013d0766b2" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.828573] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('08deede4-9aa7-42dc-ade6-53013d0766b2',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.983100] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2dad819d-4da9-4798-827e-298c399b35c5 in Status: SUCCESS [ 810.983387] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2dad819d-4da9-4798-827e-298c399b35c5" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.064034] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d7156740-676b-417b-9850-f10d741c20bd in Status: SUCCESS [ 811.064034] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d7156740-676b-417b-9850-f10d741c20bd" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.064034] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d7156740-676b-417b-9850-f10d741c20bd" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.064324] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d7156740-676b-417b-9850-f10d741c20bd" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.064367] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d7156740-676b-417b-9850-f10d741c20bd',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 811.330303] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-c1b8ce61-c092-47d3-9c53-192ccca5ff8d taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.330448] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c1b8ce61-c092-47d3-9c53-192ccca5ff8d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.334024] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c1b8ce61-c092-47d3-9c53-192ccca5ff8d',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 811.334024] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 08deede4-9aa7-42dc-ade6-53013d0766b2 with status ACTIVE [ 811.334024] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.334024] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.334024] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.334024] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.334024] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.334024] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.334024] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.334024] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.334024] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.334024] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.334024] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.334024] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.334024] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.334024] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.334681] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.334681] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 08deede4-9aa7-42dc-ade6-53013d0766b2 is going to be updated. [ 811.353985] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.354326] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.354441] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.354689] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.354860] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.354995] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-08deede4-9aa7-42dc-ade6-53013d0766b2" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.376666] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9d153fe4-605f-47fe-a33b-9d019b977fa7 in Status: SUCCESS [ 811.378589] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9d153fe4-605f-47fe-a33b-9d019b977fa7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.378589] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9d153fe4-605f-47fe-a33b-9d019b977fa7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.378589] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9d153fe4-605f-47fe-a33b-9d019b977fa7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.378589] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.378589] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.378589] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.378589] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.378589] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.378589] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9d153fe4-605f-47fe-a33b-9d019b977fa7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.378589] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9d153fe4-605f-47fe-a33b-9d019b977fa7',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 811.503874] env[69188]: INFO networking_nsxv3.common.synchronization [req-9eb019cc-0503-4f65-b823-a645f86497a0 req-31e82fe9-0dca-443e-a120-78736efd2695 tempest-ListServerFiltersTestJSON-1426102960 tempest-ListServerFiltersTestJSON-1426102960-project-member] Enqueued Resource ID: e2f14ed1-21b8-4d1e-b6bc-559e167b9967 with Priority: HIGHEST for action security_group_members [ 811.504443] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2f14ed1-21b8-4d1e-b6bc-559e167b9967 with Priority: HIGHEST for action security_group_members [ 811.504623] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2f14ed1-21b8-4d1e-b6bc-559e167b9967 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.504869] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2f14ed1-21b8-4d1e-b6bc-559e167b9967" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.505564] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2f14ed1-21b8-4d1e-b6bc-559e167b9967" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.505564] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2f14ed1-21b8-4d1e-b6bc-559e167b9967" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.505564] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.505852] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.505999] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.506251] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.507545] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.507545] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e2f14ed1-21b8-4d1e-b6bc-559e167b9967',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 811.568745] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-d7156740-676b-417b-9850-f10d741c20bd taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.568942] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d7156740-676b-417b-9850-f10d741c20bd" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.568994] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d7156740-676b-417b-9850-f10d741c20bd" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.569188] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d7156740-676b-417b-9850-f10d741c20bd" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.569351] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.569449] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.569536] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.569662] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.569752] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.569843] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d7156740-676b-417b-9850-f10d741c20bd" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.569998] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d7156740-676b-417b-9850-f10d741c20bd',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 811.837074] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c1b8ce61-c092-47d3-9c53-192ccca5ff8d',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 811.882243] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-9d153fe4-605f-47fe-a33b-9d019b977fa7 taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.882408] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9d153fe4-605f-47fe-a33b-9d019b977fa7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.882478] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9d153fe4-605f-47fe-a33b-9d019b977fa7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.882723] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9d153fe4-605f-47fe-a33b-9d019b977fa7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.883139] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.883139] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.883139] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.883295] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.883340] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.883426] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9d153fe4-605f-47fe-a33b-9d019b977fa7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.883632] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-9d153fe4-605f-47fe-a33b-9d019b977fa7 taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.883700] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9d153fe4-605f-47fe-a33b-9d019b977fa7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.883700] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9d153fe4-605f-47fe-a33b-9d019b977fa7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.883847] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9d153fe4-605f-47fe-a33b-9d019b977fa7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.883983] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.884078] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.884142] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.884273] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.884371] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.884412] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9d153fe4-605f-47fe-a33b-9d019b977fa7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.884507] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9d153fe4-605f-47fe-a33b-9d019b977fa7',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.008915] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.009088] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.009181] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.009394] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.009458] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.009830] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.009830] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.009830] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.010161] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.010161] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.010161] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e2f14ed1-21b8-4d1e-b6bc-559e167b9967 is going to be updated. [ 812.034959] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.035258] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.035258] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.035478] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.035678] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.046743] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e2f14ed1-21b8-4d1e-b6bc-559e167b9967 in Status: IN_PROGRESS for 2s [ 812.072326] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-d7156740-676b-417b-9850-f10d741c20bd taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.072489] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d7156740-676b-417b-9850-f10d741c20bd" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.072559] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d7156740-676b-417b-9850-f10d741c20bd" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.072874] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d7156740-676b-417b-9850-f10d741c20bd" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.073049] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.073159] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.073227] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.073645] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.073775] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.073878] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d7156740-676b-417b-9850-f10d741c20bd" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.074045] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-d7156740-676b-417b-9850-f10d741c20bd taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.074189] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d7156740-676b-417b-9850-f10d741c20bd" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.074256] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d7156740-676b-417b-9850-f10d741c20bd" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.074404] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d7156740-676b-417b-9850-f10d741c20bd" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.074573] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.074674] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.074738] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.074901] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.074994] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.075117] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d7156740-676b-417b-9850-f10d741c20bd" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.075195] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d7156740-676b-417b-9850-f10d741c20bd',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.340305] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.340305] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.340439] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.340586] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.340909] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.340909] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c1b8ce61-c092-47d3-9c53-192ccca5ff8d is going to be created. [ 812.366768] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.367031] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.367031] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.367337] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.367536] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.379382] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c1b8ce61-c092-47d3-9c53-192ccca5ff8d in Status: UNINITIALIZED for 2s [ 812.388307] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9d153fe4-605f-47fe-a33b-9d019b977fa7: rpc.has_security_group_logging(os_id): False [ 812.404137] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.404332] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.404377] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.404566] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.404660] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.404883] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.405014] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.405061] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.405211] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.405291] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.405468] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.405562] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.405628] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.405799] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.405878] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.406182] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.406311] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.406366] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.406515] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.406593] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.406681] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9d153fe4-605f-47fe-a33b-9d019b977fa7 is going to be updated. [ 812.468900] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.469026] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.469119] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.469447] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.469615] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.484241] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9d153fe4-605f-47fe-a33b-9d019b977fa7 in Status: IN_PROGRESS for 2s [ 812.578320] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d7156740-676b-417b-9850-f10d741c20bd: rpc.has_security_group_logging(os_id): False [ 812.609919] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.610135] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.610209] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.610419] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.610510] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.610699] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.610798] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.610859] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.611030] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.611109] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.611287] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.611381] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.611435] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.611575] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.611650] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.611835] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.611927] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.611990] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.612140] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.612215] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.612298] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d7156740-676b-417b-9850-f10d741c20bd is going to be updated. [ 812.735598] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.735684] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.735720] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.735931] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.736157] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.782338] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d7156740-676b-417b-9850-f10d741c20bd in Status: IN_PROGRESS for 2s [ 813.869023] env[69188]: INFO networking_nsxv3.common.synchronization [req-0e905264-90bd-4473-ba51-83b5d1c51462 req-d9c1be47-3e52-4fd4-9cec-dad3af91a6f5 tempest-ServersTestMultiNic-1128640872 tempest-ServersTestMultiNic-1128640872-project-member] Enqueued Resource ID: d7156740-676b-417b-9850-f10d741c20bd with Priority: HIGHEST for action security_group_members [ 813.869023] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d7156740-676b-417b-9850-f10d741c20bd with Priority: HIGHEST for action security_group_members [ 813.869023] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-d7156740-676b-417b-9850-f10d741c20bd taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.869023] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d7156740-676b-417b-9850-f10d741c20bd" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.869023] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d7156740-676b-417b-9850-f10d741c20bd" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.869023] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d7156740-676b-417b-9850-f10d741c20bd" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.869569] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.869569] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.869569] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.869569] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.869569] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.869569] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d7156740-676b-417b-9850-f10d741c20bd',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.056992] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e2f14ed1-21b8-4d1e-b6bc-559e167b9967 in Status: SUCCESS [ 814.057524] env[69188]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e2f14ed1-21b8-4d1e-b6bc-559e167b9967 deletion is rescheduled due to dependency. [ 814.061199] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2f14ed1-21b8-4d1e-b6bc-559e167b9967" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.244731] env[69188]: INFO networking_nsxv3.common.synchronization [req-0e905264-90bd-4473-ba51-83b5d1c51462 req-9591b035-a85e-4d18-83b8-676b54fd061e tempest-ServersTestMultiNic-1128640872 tempest-ServersTestMultiNic-1128640872-project-member] Enqueued Resource ID: d7156740-676b-417b-9850-f10d741c20bd with Priority: HIGHEST for action security_group_members [ 814.246953] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d7156740-676b-417b-9850-f10d741c20bd with Priority: HIGHEST for action security_group_members [ 814.246953] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-d7156740-676b-417b-9850-f10d741c20bd taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.246953] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d7156740-676b-417b-9850-f10d741c20bd" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.372418] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d7156740-676b-417b-9850-f10d741c20bd',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.391281] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c1b8ce61-c092-47d3-9c53-192ccca5ff8d in Status: SUCCESS [ 814.391504] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c1b8ce61-c092-47d3-9c53-192ccca5ff8d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.391667] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c1b8ce61-c092-47d3-9c53-192ccca5ff8d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.391884] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c1b8ce61-c092-47d3-9c53-192ccca5ff8d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.392082] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.392202] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.392262] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.392402] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.392485] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.392571] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c1b8ce61-c092-47d3-9c53-192ccca5ff8d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.392770] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c1b8ce61-c092-47d3-9c53-192ccca5ff8d',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.498582] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9d153fe4-605f-47fe-a33b-9d019b977fa7 in Status: SUCCESS [ 814.498582] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9d153fe4-605f-47fe-a33b-9d019b977fa7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.710957] env[69188]: INFO networking_nsxv3.common.synchronization [req-0e905264-90bd-4473-ba51-83b5d1c51462 req-f3af1f25-d62a-4e8c-8afb-9095fc43f804 tempest-ServersTestMultiNic-1128640872 tempest-ServersTestMultiNic-1128640872-project-member] Enqueued Resource ID: d7156740-676b-417b-9850-f10d741c20bd with Priority: HIGHEST for action security_group_members [ 814.713061] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d7156740-676b-417b-9850-f10d741c20bd with Priority: HIGHEST for action security_group_members [ 814.713391] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-d7156740-676b-417b-9850-f10d741c20bd taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.713497] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d7156740-676b-417b-9850-f10d741c20bd" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.796696] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d7156740-676b-417b-9850-f10d741c20bd in Status: SUCCESS [ 814.796696] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d7156740-676b-417b-9850-f10d741c20bd" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.876301] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d7156740-676b-417b-9850-f10d741c20bd',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.900693] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-c1b8ce61-c092-47d3-9c53-192ccca5ff8d taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.900693] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c1b8ce61-c092-47d3-9c53-192ccca5ff8d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.900693] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c1b8ce61-c092-47d3-9c53-192ccca5ff8d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.901736] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c1b8ce61-c092-47d3-9c53-192ccca5ff8d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.901736] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.901736] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.901736] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.901736] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.901736] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.901736] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c1b8ce61-c092-47d3-9c53-192ccca5ff8d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.902628] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-c1b8ce61-c092-47d3-9c53-192ccca5ff8d taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.902628] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c1b8ce61-c092-47d3-9c53-192ccca5ff8d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.902628] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c1b8ce61-c092-47d3-9c53-192ccca5ff8d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.902628] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c1b8ce61-c092-47d3-9c53-192ccca5ff8d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.902628] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.903065] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.903065] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.903065] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.903065] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.903202] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c1b8ce61-c092-47d3-9c53-192ccca5ff8d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.903202] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c1b8ce61-c092-47d3-9c53-192ccca5ff8d',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.263057] env[69188]: INFO networking_nsxv3.common.synchronization [req-633154ee-f4a9-4c73-b234-bcdcdac0299a req-48870304-c486-40dd-ac44-5cb3fb58efc4 tempest-ServersAdminTestJSON-1988649207 tempest-ServersAdminTestJSON-1988649207-project-member] Enqueued Resource ID: 5e76d42e-7ec6-4a5e-aa9c-c5a285d62318 with Priority: HIGHEST for action security_group_members [ 815.263657] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e76d42e-7ec6-4a5e-aa9c-c5a285d62318 with Priority: HIGHEST for action security_group_members [ 815.263957] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e76d42e-7ec6-4a5e-aa9c-c5a285d62318 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.264931] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e76d42e-7ec6-4a5e-aa9c-c5a285d62318" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.265021] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e76d42e-7ec6-4a5e-aa9c-c5a285d62318" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.265236] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e76d42e-7ec6-4a5e-aa9c-c5a285d62318" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.265402] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.265505] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.265571] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.265777] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.265869] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.265964] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5e76d42e-7ec6-4a5e-aa9c-c5a285d62318',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.384034] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.384034] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.384034] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.384034] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.384034] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.384034] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d7156740-676b-417b-9850-f10d741c20bd is going to be updated. [ 815.408826] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c1b8ce61-c092-47d3-9c53-192ccca5ff8d: rpc.has_security_group_logging(os_id): False [ 815.421246] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.421413] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.421458] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.421683] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.421839] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.429696] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.430011] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.430011] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.430200] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.430319] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.430645] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.430768] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.430888] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.431105] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.431219] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.431442] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.431550] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.431627] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.431890] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.431890] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.432506] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.432633] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.432697] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.432848] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.432927] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.433031] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c1b8ce61-c092-47d3-9c53-192ccca5ff8d is going to be created. [ 815.434802] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d7156740-676b-417b-9850-f10d741c20bd in Status: IN_PROGRESS for 2s [ 815.492691] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.492900] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.492995] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.493316] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.493589] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.504562] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c1b8ce61-c092-47d3-9c53-192ccca5ff8d in Status: IN_PROGRESS for 2s [ 815.702619] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock network-932 taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.702998] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "network-932" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.702998] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "network-932" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.703265] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "network-932" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.703550] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.703738] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.703848] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.704057] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.704209] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.704580] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 815.704815] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] NeedRegenerationException {{(pid=69188) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 815.705014] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] no value, waiting for create lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 815.705138] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] value creation lock acquired {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 815.705314] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 815.705463] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Calling creation function for not-yet-present value {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 815.705496] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 815.732216] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 815.732389] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=69188) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 815.732600] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Released creation lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 815.732785] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "network-932" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.733144] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock port-377a5b5c-b47c-4968-a0fb-71c0af630466 taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.733443] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "port-377a5b5c-b47c-4968-a0fb-71c0af630466" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.733634] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "port-377a5b5c-b47c-4968-a0fb-71c0af630466" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.733988] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "port-377a5b5c-b47c-4968-a0fb-71c0af630466" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.734292] env[69188]: DEBUG networking_nsxv3.api.rpc [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('377a5b5c-b47c-4968-a0fb-71c0af630466',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.769017] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5e76d42e-7ec6-4a5e-aa9c-c5a285d62318',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.185275] env[69188]: INFO networking_nsxv3.common.synchronization [req-09642993-53e9-496d-b785-cce6ada456d0 req-0bcafdf4-c2c5-4fb5-9b92-c9825b247175 tempest-ServerRescueTestJSONUnderV235-1972914019 tempest-ServerRescueTestJSONUnderV235-1972914019-project-member] Enqueued Resource ID: 44c5b379-bd5b-44a8-ad31-bc9a9b51d60e with Priority: HIGHEST for action security_group_members [ 816.185707] env[69188]: INFO networking_nsxv3.common.synchronization [req-09642993-53e9-496d-b785-cce6ada456d0 req-0bcafdf4-c2c5-4fb5-9b92-c9825b247175 tempest-ServerRescueTestJSONUnderV235-1972914019 tempest-ServerRescueTestJSONUnderV235-1972914019-project-member] Enqueued Resource ID: d4fc5f9c-09a3-4828-aeb8-f4b4a45b8375 with Priority: HIGHEST for action security_group_members [ 816.185984] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 44c5b379-bd5b-44a8-ad31-bc9a9b51d60e with Priority: HIGHEST for action security_group_members [ 816.186258] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d4fc5f9c-09a3-4828-aeb8-f4b4a45b8375 with Priority: HIGHEST for action security_group_members [ 816.186425] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-44c5b379-bd5b-44a8-ad31-bc9a9b51d60e taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.186556] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-44c5b379-bd5b-44a8-ad31-bc9a9b51d60e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.186621] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-44c5b379-bd5b-44a8-ad31-bc9a9b51d60e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.186826] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-44c5b379-bd5b-44a8-ad31-bc9a9b51d60e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.186982] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.187098] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.187278] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.187278] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.187397] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.187570] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('44c5b379-bd5b-44a8-ad31-bc9a9b51d60e',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.188840] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-d4fc5f9c-09a3-4828-aeb8-f4b4a45b8375 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.188840] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d4fc5f9c-09a3-4828-aeb8-f4b4a45b8375" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.188840] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d4fc5f9c-09a3-4828-aeb8-f4b4a45b8375" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.188840] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d4fc5f9c-09a3-4828-aeb8-f4b4a45b8375" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.189466] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.189466] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.189466] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.189466] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.189466] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.189466] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d4fc5f9c-09a3-4828-aeb8-f4b4a45b8375',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.238096] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.238357] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.238507] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.238854] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.239068] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.239314] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Segment Port 377a5b5c-b47c-4968-a0fb-71c0af630466 not found, creating... [ 816.239757] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.239946] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.240122] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.240390] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.240574] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.240910] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.241280] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.241431] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.241710] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.241873] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.242033] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Resource: SegmentPort with ID: 377a5b5c-b47c-4968-a0fb-71c0af630466 is going to be created. [ 816.246999] env[69188]: INFO networking_nsxv3.common.synchronization [req-09642993-53e9-496d-b785-cce6ada456d0 req-0bcafdf4-c2c5-4fb5-9b92-c9825b247175 tempest-ServerRescueTestJSONUnderV235-1972914019 tempest-ServerRescueTestJSONUnderV235-1972914019-project-member] Enqueued Resource ID: 44c5b379-bd5b-44a8-ad31-bc9a9b51d60e with Priority: HIGHEST for action security_group_rules [ 816.247249] env[69188]: INFO networking_nsxv3.common.synchronization [req-09642993-53e9-496d-b785-cce6ada456d0 req-0bcafdf4-c2c5-4fb5-9b92-c9825b247175 tempest-ServerRescueTestJSONUnderV235-1972914019 tempest-ServerRescueTestJSONUnderV235-1972914019-project-member] Enqueued Resource ID: 44c5b379-bd5b-44a8-ad31-bc9a9b51d60e with Priority: HIGHEST for action security_group_members [ 816.247804] env[69188]: INFO networking_nsxv3.common.synchronization [req-09642993-53e9-496d-b785-cce6ada456d0 req-0bcafdf4-c2c5-4fb5-9b92-c9825b247175 tempest-ServerRescueTestJSONUnderV235-1972914019 tempest-ServerRescueTestJSONUnderV235-1972914019-project-member] Enqueued Resource ID: d4fc5f9c-09a3-4828-aeb8-f4b4a45b8375 with Priority: HIGHEST for action security_group_rules [ 816.247942] env[69188]: INFO networking_nsxv3.common.synchronization [req-09642993-53e9-496d-b785-cce6ada456d0 req-0bcafdf4-c2c5-4fb5-9b92-c9825b247175 tempest-ServerRescueTestJSONUnderV235-1972914019 tempest-ServerRescueTestJSONUnderV235-1972914019-project-member] Enqueued Resource ID: d4fc5f9c-09a3-4828-aeb8-f4b4a45b8375 with Priority: HIGHEST for action security_group_members [ 816.248101] env[69188]: INFO networking_nsxv3.common.synchronization [req-09642993-53e9-496d-b785-cce6ada456d0 req-0bcafdf4-c2c5-4fb5-9b92-c9825b247175 tempest-ServerRescueTestJSONUnderV235-1972914019 tempest-ServerRescueTestJSONUnderV235-1972914019-project-member] Enqueued Resource ID: 11a341eb-c60a-4b7d-9c89-13cf16638e62 with Priority: HIGHEST for action port [ 816.248579] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 44c5b379-bd5b-44a8-ad31-bc9a9b51d60e with Priority: HIGHEST for action security_group_rules [ 816.248715] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d4fc5f9c-09a3-4828-aeb8-f4b4a45b8375 with Priority: HIGHEST for action security_group_rules [ 816.248814] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 11a341eb-c60a-4b7d-9c89-13cf16638e62 with Priority: HIGHEST for action port [ 816.248906] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 44c5b379-bd5b-44a8-ad31-bc9a9b51d60e with Priority: HIGHEST for action security_group_members [ 816.249032] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d4fc5f9c-09a3-4828-aeb8-f4b4a45b8375 with Priority: HIGHEST for action security_group_members [ 816.249309] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-44c5b379-bd5b-44a8-ad31-bc9a9b51d60e taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.249446] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-44c5b379-bd5b-44a8-ad31-bc9a9b51d60e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.249546] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-44c5b379-bd5b-44a8-ad31-bc9a9b51d60e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.249734] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-44c5b379-bd5b-44a8-ad31-bc9a9b51d60e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.249816] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('44c5b379-bd5b-44a8-ad31-bc9a9b51d60e',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.250775] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d4fc5f9c-09a3-4828-aeb8-f4b4a45b8375 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.250888] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d4fc5f9c-09a3-4828-aeb8-f4b4a45b8375" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.250939] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d4fc5f9c-09a3-4828-aeb8-f4b4a45b8375" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.251197] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d4fc5f9c-09a3-4828-aeb8-f4b4a45b8375" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.251277] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d4fc5f9c-09a3-4828-aeb8-f4b4a45b8375',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.252167] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-11a341eb-c60a-4b7d-9c89-13cf16638e62 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.252277] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-11a341eb-c60a-4b7d-9c89-13cf16638e62" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.252359] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-11a341eb-c60a-4b7d-9c89-13cf16638e62" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.252554] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-11a341eb-c60a-4b7d-9c89-13cf16638e62" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.252629] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('11a341eb-c60a-4b7d-9c89-13cf16638e62',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.253468] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-44c5b379-bd5b-44a8-ad31-bc9a9b51d60e taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.253574] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-44c5b379-bd5b-44a8-ad31-bc9a9b51d60e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.253820] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-d4fc5f9c-09a3-4828-aeb8-f4b4a45b8375 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.253913] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d4fc5f9c-09a3-4828-aeb8-f4b4a45b8375" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.265275] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.265518] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.265645] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.265928] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.266174] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.266918] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "port-377a5b5c-b47c-4968-a0fb-71c0af630466" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.272357] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5e76d42e-7ec6-4a5e-aa9c-c5a285d62318',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.692868] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('44c5b379-bd5b-44a8-ad31-bc9a9b51d60e',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.693482] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d4fc5f9c-09a3-4828-aeb8-f4b4a45b8375',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.755273] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-d4fc5f9c-09a3-4828-aeb8-f4b4a45b8375 taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.757633] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d4fc5f9c-09a3-4828-aeb8-f4b4a45b8375" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.757633] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-44c5b379-bd5b-44a8-ad31-bc9a9b51d60e taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.757633] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-44c5b379-bd5b-44a8-ad31-bc9a9b51d60e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.757633] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 11a341eb-c60a-4b7d-9c89-13cf16638e62 with status ACTIVE [ 816.757633] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.757633] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.757633] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.757633] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.757633] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.757633] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.757633] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.757633] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.757633] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.757633] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.758448] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.758448] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.758448] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.758448] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.758448] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.758448] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 11a341eb-c60a-4b7d-9c89-13cf16638e62 is going to be updated. [ 816.774100] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.774276] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.774344] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.774499] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.774585] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.774672] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5e76d42e-7ec6-4a5e-aa9c-c5a285d62318 is going to be updated. [ 816.786562] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.786562] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.786562] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.787150] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.787150] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.787150] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-11a341eb-c60a-4b7d-9c89-13cf16638e62" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.805708] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.806212] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.806212] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.806212] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.806350] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.820692] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5e76d42e-7ec6-4a5e-aa9c-c5a285d62318 in Status: IN_PROGRESS for 2s [ 817.146181] env[69188]: INFO networking_nsxv3.common.synchronization [req-9ffffb69-b40a-4216-b35e-dd33c2c8c103 req-b9e6a825-95d6-4ccf-85f3-64d050ae2add tempest-ServerRescueTestJSONUnderV235-1972914019 tempest-ServerRescueTestJSONUnderV235-1972914019-project-member] Enqueued Resource ID: 44c5b379-bd5b-44a8-ad31-bc9a9b51d60e with Priority: HIGHEST for action security_group_members [ 817.146181] env[69188]: INFO networking_nsxv3.common.synchronization [req-9ffffb69-b40a-4216-b35e-dd33c2c8c103 req-b9e6a825-95d6-4ccf-85f3-64d050ae2add tempest-ServerRescueTestJSONUnderV235-1972914019 tempest-ServerRescueTestJSONUnderV235-1972914019-project-member] Enqueued Resource ID: d4fc5f9c-09a3-4828-aeb8-f4b4a45b8375 with Priority: HIGHEST for action security_group_members [ 817.146602] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 44c5b379-bd5b-44a8-ad31-bc9a9b51d60e with Priority: HIGHEST for action security_group_members [ 817.146737] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d4fc5f9c-09a3-4828-aeb8-f4b4a45b8375 with Priority: HIGHEST for action security_group_members [ 817.147010] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-44c5b379-bd5b-44a8-ad31-bc9a9b51d60e taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.147117] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-44c5b379-bd5b-44a8-ad31-bc9a9b51d60e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.147303] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-d4fc5f9c-09a3-4828-aeb8-f4b4a45b8375 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.147929] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d4fc5f9c-09a3-4828-aeb8-f4b4a45b8375" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.195906] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('44c5b379-bd5b-44a8-ad31-bc9a9b51d60e',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.196841] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d4fc5f9c-09a3-4828-aeb8-f4b4a45b8375',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.260287] env[69188]: INFO networking_nsxv3.common.synchronization [req-9ffffb69-b40a-4216-b35e-dd33c2c8c103 req-b9e6a825-95d6-4ccf-85f3-64d050ae2add tempest-ServerRescueTestJSONUnderV235-1972914019 tempest-ServerRescueTestJSONUnderV235-1972914019-project-member] Enqueued Resource ID: 44c5b379-bd5b-44a8-ad31-bc9a9b51d60e with Priority: HIGHEST for action security_group_rules [ 817.260631] env[69188]: INFO networking_nsxv3.common.synchronization [req-9ffffb69-b40a-4216-b35e-dd33c2c8c103 req-b9e6a825-95d6-4ccf-85f3-64d050ae2add tempest-ServerRescueTestJSONUnderV235-1972914019 tempest-ServerRescueTestJSONUnderV235-1972914019-project-member] Enqueued Resource ID: 44c5b379-bd5b-44a8-ad31-bc9a9b51d60e with Priority: HIGHEST for action security_group_members [ 817.260631] env[69188]: INFO networking_nsxv3.common.synchronization [req-9ffffb69-b40a-4216-b35e-dd33c2c8c103 req-b9e6a825-95d6-4ccf-85f3-64d050ae2add tempest-ServerRescueTestJSONUnderV235-1972914019 tempest-ServerRescueTestJSONUnderV235-1972914019-project-member] Enqueued Resource ID: 11a341eb-c60a-4b7d-9c89-13cf16638e62 with Priority: HIGHEST for action port [ 817.261091] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 44c5b379-bd5b-44a8-ad31-bc9a9b51d60e with Priority: HIGHEST for action security_group_rules [ 817.261228] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 44c5b379-bd5b-44a8-ad31-bc9a9b51d60e with Priority: HIGHEST for action security_group_members [ 817.261328] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 11a341eb-c60a-4b7d-9c89-13cf16638e62 with Priority: HIGHEST for action port [ 817.261593] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-44c5b379-bd5b-44a8-ad31-bc9a9b51d60e taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.261695] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-44c5b379-bd5b-44a8-ad31-bc9a9b51d60e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.261892] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-44c5b379-bd5b-44a8-ad31-bc9a9b51d60e taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.261982] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-44c5b379-bd5b-44a8-ad31-bc9a9b51d60e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.262191] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-11a341eb-c60a-4b7d-9c89-13cf16638e62 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.262306] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-11a341eb-c60a-4b7d-9c89-13cf16638e62" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.262957] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-11a341eb-c60a-4b7d-9c89-13cf16638e62" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.262957] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-11a341eb-c60a-4b7d-9c89-13cf16638e62" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.262957] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('11a341eb-c60a-4b7d-9c89-13cf16638e62',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.270107] env[69188]: INFO networking_nsxv3.common.synchronization [req-633154ee-f4a9-4c73-b234-bcdcdac0299a req-46e2b1fa-c58a-4940-9613-0fe74f222a64 service nova] Enqueued Resource ID: 5e76d42e-7ec6-4a5e-aa9c-c5a285d62318 with Priority: HIGHEST for action security_group_rules [ 817.270278] env[69188]: INFO networking_nsxv3.common.synchronization [req-633154ee-f4a9-4c73-b234-bcdcdac0299a req-46e2b1fa-c58a-4940-9613-0fe74f222a64 service nova] Enqueued Resource ID: 5e76d42e-7ec6-4a5e-aa9c-c5a285d62318 with Priority: HIGHEST for action security_group_members [ 817.270411] env[69188]: INFO networking_nsxv3.common.synchronization [req-633154ee-f4a9-4c73-b234-bcdcdac0299a req-46e2b1fa-c58a-4940-9613-0fe74f222a64 service nova] Enqueued Resource ID: 377a5b5c-b47c-4968-a0fb-71c0af630466 with Priority: HIGHEST for action port [ 817.270687] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e76d42e-7ec6-4a5e-aa9c-c5a285d62318 with Priority: HIGHEST for action security_group_rules [ 817.270747] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e76d42e-7ec6-4a5e-aa9c-c5a285d62318 with Priority: HIGHEST for action security_group_members [ 817.270817] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 377a5b5c-b47c-4968-a0fb-71c0af630466 with Priority: HIGHEST for action port [ 817.271310] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5e76d42e-7ec6-4a5e-aa9c-c5a285d62318 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.271480] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5e76d42e-7ec6-4a5e-aa9c-c5a285d62318" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.271480] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5e76d42e-7ec6-4a5e-aa9c-c5a285d62318" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.274141] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5e76d42e-7ec6-4a5e-aa9c-c5a285d62318" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.274234] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5e76d42e-7ec6-4a5e-aa9c-c5a285d62318',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.279141] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e76d42e-7ec6-4a5e-aa9c-c5a285d62318 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.279222] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e76d42e-7ec6-4a5e-aa9c-c5a285d62318" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.279430] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-377a5b5c-b47c-4968-a0fb-71c0af630466 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.279522] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-377a5b5c-b47c-4968-a0fb-71c0af630466" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.279582] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-377a5b5c-b47c-4968-a0fb-71c0af630466" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.279771] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-377a5b5c-b47c-4968-a0fb-71c0af630466" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.279845] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('377a5b5c-b47c-4968-a0fb-71c0af630466',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.444198] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d7156740-676b-417b-9850-f10d741c20bd in Status: SUCCESS [ 817.444422] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d7156740-676b-417b-9850-f10d741c20bd" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.444602] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d7156740-676b-417b-9850-f10d741c20bd" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.444816] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d7156740-676b-417b-9850-f10d741c20bd" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.445007] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.445127] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.445251] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.445332] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.445412] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.445507] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d7156740-676b-417b-9850-f10d741c20bd',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.517709] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c1b8ce61-c092-47d3-9c53-192ccca5ff8d in Status: SUCCESS [ 817.517993] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c1b8ce61-c092-47d3-9c53-192ccca5ff8d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.703020] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.703258] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.703329] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.703511] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.703605] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.703703] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d4fc5f9c-09a3-4828-aeb8-f4b4a45b8375 is going to be created. [ 817.705046] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.705185] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.705312] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.705422] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.705508] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.705597] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 44c5b379-bd5b-44a8-ad31-bc9a9b51d60e is going to be updated. [ 817.740257] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.740734] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.740845] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.741037] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.741201] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.753598] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.753740] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.753807] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.754051] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.754204] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.756074] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d4fc5f9c-09a3-4828-aeb8-f4b4a45b8375 in Status: UNINITIALIZED for 2s [ 817.765878] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 44c5b379-bd5b-44a8-ad31-bc9a9b51d60e in Status: IN_PROGRESS for 2s [ 817.766115] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 11a341eb-c60a-4b7d-9c89-13cf16638e62 with status ACTIVE [ 817.766269] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.766391] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.766464] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.766659] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.766747] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.766925] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.767031] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.767092] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.767237] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.767314] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.767490] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.767580] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.767635] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.767868] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.768107] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.768223] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 11a341eb-c60a-4b7d-9c89-13cf16638e62 is going to be updated. [ 817.781194] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e76d42e-7ec6-4a5e-aa9c-c5a285d62318 taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.781365] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e76d42e-7ec6-4a5e-aa9c-c5a285d62318" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.782764] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 377a5b5c-b47c-4968-a0fb-71c0af630466 with status ACTIVE [ 817.782954] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.783084] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.783174] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.783355] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.783440] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.783612] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.783706] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.783762] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.783920] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.784027] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.784202] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.784299] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.784366] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.784495] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.784569] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.784653] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 377a5b5c-b47c-4968-a0fb-71c0af630466 is going to be updated. [ 817.807377] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.807594] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.807594] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.810111] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.810111] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.810111] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-11a341eb-c60a-4b7d-9c89-13cf16638e62" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.810111] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.810111] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.810111] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.810111] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.810111] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.811574] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-377a5b5c-b47c-4968-a0fb-71c0af630466" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.948674] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.948830] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.949038] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.949386] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.949614] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.950105] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.950387] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.950470] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.951901] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.952243] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.952357] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d7156740-676b-417b-9850-f10d741c20bd is going to be updated. [ 817.982498] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.982880] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.982966] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.983232] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.983393] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.991856] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d7156740-676b-417b-9850-f10d741c20bd in Status: IN_PROGRESS for 2s [ 818.734016] env[69188]: INFO networking_nsxv3.common.synchronization [None req-54b2eb88-7ae2-456c-9c5c-2442af7801a9 None None] Enqueued Resource ID: 674c7f07-f79c-4e6b-94b1-d636e2840cf6 with Priority: HIGHEST for action port [ 818.734016] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 674c7f07-f79c-4e6b-94b1-d636e2840cf6 with Priority: HIGHEST for action port [ 818.734016] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-674c7f07-f79c-4e6b-94b1-d636e2840cf6 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.734016] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-674c7f07-f79c-4e6b-94b1-d636e2840cf6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.734016] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-674c7f07-f79c-4e6b-94b1-d636e2840cf6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.738435] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-674c7f07-f79c-4e6b-94b1-d636e2840cf6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.738435] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('674c7f07-f79c-4e6b-94b1-d636e2840cf6',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.832685] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5e76d42e-7ec6-4a5e-aa9c-c5a285d62318 in Status: SUCCESS [ 818.838659] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e76d42e-7ec6-4a5e-aa9c-c5a285d62318" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.838659] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e76d42e-7ec6-4a5e-aa9c-c5a285d62318" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.838659] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e76d42e-7ec6-4a5e-aa9c-c5a285d62318" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.838659] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.838659] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.838659] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.838659] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.838659] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.838659] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5e76d42e-7ec6-4a5e-aa9c-c5a285d62318',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.243606] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 674c7f07-f79c-4e6b-94b1-d636e2840cf6 [ 819.243913] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.244072] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.244164] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.244412] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.244532] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.244648] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:674c7f07-f79c-4e6b-94b1-d636e2840cf6 already deleted. [ 819.244742] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-674c7f07-f79c-4e6b-94b1-d636e2840cf6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.341538] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5e76d42e-7ec6-4a5e-aa9c-c5a285d62318',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.766875] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d4fc5f9c-09a3-4828-aeb8-f4b4a45b8375 in Status: SUCCESS [ 819.767534] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d4fc5f9c-09a3-4828-aeb8-f4b4a45b8375" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.768604] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d4fc5f9c-09a3-4828-aeb8-f4b4a45b8375" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.768852] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d4fc5f9c-09a3-4828-aeb8-f4b4a45b8375" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.772343] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.772523] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.772598] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.772799] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.773907] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.773907] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d4fc5f9c-09a3-4828-aeb8-f4b4a45b8375',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.780638] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 44c5b379-bd5b-44a8-ad31-bc9a9b51d60e in Status: SUCCESS [ 819.780957] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-44c5b379-bd5b-44a8-ad31-bc9a9b51d60e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.781152] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-44c5b379-bd5b-44a8-ad31-bc9a9b51d60e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.781412] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-44c5b379-bd5b-44a8-ad31-bc9a9b51d60e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.781548] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.781667] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.781734] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.781887] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.781972] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.782087] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('44c5b379-bd5b-44a8-ad31-bc9a9b51d60e',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.846993] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5e76d42e-7ec6-4a5e-aa9c-c5a285d62318',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.003473] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d7156740-676b-417b-9850-f10d741c20bd in Status: SUCCESS [ 820.004382] env[69188]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d7156740-676b-417b-9850-f10d741c20bd deletion is rescheduled due to dependency. [ 820.004618] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d7156740-676b-417b-9850-f10d741c20bd" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.004998] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d7156740-676b-417b-9850-f10d741c20bd" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.005194] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d7156740-676b-417b-9850-f10d741c20bd" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.005390] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.005514] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.005649] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.005871] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.005963] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.006050] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d7156740-676b-417b-9850-f10d741c20bd',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.206426] env[69188]: INFO networking_nsxv3.common.synchronization [req-511dd91c-cb67-4e11-a74f-10cc3ea38c46 req-2183c058-7f91-498d-909f-8ebc081207ac tempest-ServerAddressesTestJSON-2052626003 tempest-ServerAddressesTestJSON-2052626003-project-member] Enqueued Resource ID: 948c6e1f-1c67-4d7c-bf02-0ca6a7c3cbda with Priority: HIGHEST for action security_group_members [ 820.207369] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 948c6e1f-1c67-4d7c-bf02-0ca6a7c3cbda with Priority: HIGHEST for action security_group_members [ 820.207369] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-948c6e1f-1c67-4d7c-bf02-0ca6a7c3cbda taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.207515] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-948c6e1f-1c67-4d7c-bf02-0ca6a7c3cbda" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.207515] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-948c6e1f-1c67-4d7c-bf02-0ca6a7c3cbda" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.208228] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-948c6e1f-1c67-4d7c-bf02-0ca6a7c3cbda" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.208228] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.208228] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.208228] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.208455] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.208455] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.208455] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('948c6e1f-1c67-4d7c-bf02-0ca6a7c3cbda',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.276516] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.276863] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.277037] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.277330] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.277542] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.277876] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.278223] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.279184] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.279431] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.279548] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.279665] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d4fc5f9c-09a3-4828-aeb8-f4b4a45b8375 is going to be deleted. [ 820.284600] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('44c5b379-bd5b-44a8-ad31-bc9a9b51d60e',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.313482] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.313482] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.313482] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.313482] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.313482] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.313482] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d4fc5f9c-09a3-4828-aeb8-f4b4a45b8375" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.313482] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d4fc5f9c-09a3-4828-aeb8-f4b4a45b8375" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.313482] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d4fc5f9c-09a3-4828-aeb8-f4b4a45b8375" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.313482] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.313482] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.313482] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.313482] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.313482] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.313482] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d4fc5f9c-09a3-4828-aeb8-f4b4a45b8375',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.351604] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.351604] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.351604] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.352162] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.352334] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.352476] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5e76d42e-7ec6-4a5e-aa9c-c5a285d62318 is going to be updated. [ 820.379787] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.379947] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.380068] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.380266] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.380415] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.399769] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5e76d42e-7ec6-4a5e-aa9c-c5a285d62318 in Status: IN_PROGRESS for 2s [ 820.510037] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.510259] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.510259] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.510486] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.510603] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.510856] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.510937] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.510937] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.511185] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.511325] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.511451] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d7156740-676b-417b-9850-f10d741c20bd is going to be updated. [ 820.535569] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.535754] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.535904] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.536339] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.536339] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.544314] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d7156740-676b-417b-9850-f10d741c20bd in Status: IN_PROGRESS for 2s [ 820.718091] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.718091] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.718091] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.718091] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.718091] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.718614] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.718614] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.718614] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.718614] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.718614] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.718790] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 948c6e1f-1c67-4d7c-bf02-0ca6a7c3cbda already deleted. [ 820.718790] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-948c6e1f-1c67-4d7c-bf02-0ca6a7c3cbda" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.787589] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('44c5b379-bd5b-44a8-ad31-bc9a9b51d60e',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.817056] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.817056] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.817056] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.817056] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.817056] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.817056] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.817056] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.817056] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.817056] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.817582] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.817582] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d4fc5f9c-09a3-4828-aeb8-f4b4a45b8375 already deleted. [ 820.817582] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d4fc5f9c-09a3-4828-aeb8-f4b4a45b8375" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.817582] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d4fc5f9c-09a3-4828-aeb8-f4b4a45b8375',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.818561] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d4fc5f9c-09a3-4828-aeb8-f4b4a45b8375" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.818741] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d4fc5f9c-09a3-4828-aeb8-f4b4a45b8375" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.818907] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.819025] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.819089] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.819235] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.819313] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.819405] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d4fc5f9c-09a3-4828-aeb8-f4b4a45b8375',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.915099] env[69188]: INFO networking_nsxv3.common.synchronization [None req-31b9fe34-d229-4b02-b62c-dbc1c965f71c None None] Enqueued Resource ID: 1873f5e7-a352-49f3-a180-3872a8a977a3 with Priority: HIGHEST for action port [ 820.919951] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1873f5e7-a352-49f3-a180-3872a8a977a3 with Priority: HIGHEST for action port [ 820.919951] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-1873f5e7-a352-49f3-a180-3872a8a977a3 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.919951] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1873f5e7-a352-49f3-a180-3872a8a977a3" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.919951] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1873f5e7-a352-49f3-a180-3872a8a977a3" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.919951] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1873f5e7-a352-49f3-a180-3872a8a977a3" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.919951] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1873f5e7-a352-49f3-a180-3872a8a977a3',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.953577] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock network-208 taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.953577] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "network-208" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.953577] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "network-208" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.955429] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "network-208" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.955852] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.955985] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.956126] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.956718] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.956904] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.957141] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 820.957300] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] NeedRegenerationException {{(pid=69188) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 820.957439] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] no value, waiting for create lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 820.957566] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] value creation lock acquired {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 820.957686] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 820.957826] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Calling creation function for not-yet-present value {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 820.961022] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 820.977019] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 820.977019] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=69188) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 820.977019] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Released creation lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 820.977019] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "network-208" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.977019] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock port-fc4f7a45-913f-4096-98dc-75ff9f4ef2ef taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.977019] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "port-fc4f7a45-913f-4096-98dc-75ff9f4ef2ef" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.977019] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "port-fc4f7a45-913f-4096-98dc-75ff9f4ef2ef" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.977019] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "port-fc4f7a45-913f-4096-98dc-75ff9f4ef2ef" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.977019] env[69188]: DEBUG networking_nsxv3.api.rpc [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fc4f7a45-913f-4096-98dc-75ff9f4ef2ef',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.166266] env[69188]: INFO networking_nsxv3.common.synchronization [None req-5c574bea-05ba-4900-9ba9-bfd9b516ff16 tempest-ServerActionsV293TestJSON-1161713519 tempest-ServerActionsV293TestJSON-1161713519-project-member] Enqueued Resource ID: 8f01fd17-613c-4bd7-9c6b-8b39ac58be72 with Priority: HIGHEST for action security_group_rules [ 821.166266] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f01fd17-613c-4bd7-9c6b-8b39ac58be72 with Priority: HIGHEST for action security_group_rules [ 821.166640] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8f01fd17-613c-4bd7-9c6b-8b39ac58be72 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.166640] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8f01fd17-613c-4bd7-9c6b-8b39ac58be72" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.166640] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8f01fd17-613c-4bd7-9c6b-8b39ac58be72" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.167310] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8f01fd17-613c-4bd7-9c6b-8b39ac58be72" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.167475] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8f01fd17-613c-4bd7-9c6b-8b39ac58be72',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.290422] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.290665] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.290766] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.291085] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.291245] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.291404] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 44c5b379-bd5b-44a8-ad31-bc9a9b51d60e is going to be updated. [ 821.309312] env[69188]: INFO networking_nsxv3.common.synchronization [None req-811187eb-108b-402e-be49-82e723f19ca4 tempest-ServerActionsV293TestJSON-1161713519 tempest-ServerActionsV293TestJSON-1161713519-project-member] Enqueued Resource ID: 8f01fd17-613c-4bd7-9c6b-8b39ac58be72 with Priority: HIGHEST for action security_group_rules [ 821.309312] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f01fd17-613c-4bd7-9c6b-8b39ac58be72 with Priority: HIGHEST for action security_group_rules [ 821.309632] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8f01fd17-613c-4bd7-9c6b-8b39ac58be72 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.309794] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8f01fd17-613c-4bd7-9c6b-8b39ac58be72" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.318947] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.319174] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.319229] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.319448] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.319588] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.324082] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d4fc5f9c-09a3-4828-aeb8-f4b4a45b8375',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.324163] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.324263] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.324329] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.324484] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.324564] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.324743] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.324839] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.324902] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.325054] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.325131] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.325214] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d4fc5f9c-09a3-4828-aeb8-f4b4a45b8375 already deleted. [ 821.325291] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d4fc5f9c-09a3-4828-aeb8-f4b4a45b8375" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.326999] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 44c5b379-bd5b-44a8-ad31-bc9a9b51d60e in Status: IN_PROGRESS for 2s [ 821.423369] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1873f5e7-a352-49f3-a180-3872a8a977a3 [ 821.423632] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.423832] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.423905] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.424181] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.424277] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.424394] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1873f5e7-a352-49f3-a180-3872a8a977a3 already deleted. [ 821.424513] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1873f5e7-a352-49f3-a180-3872a8a977a3" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.482088] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.482412] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.482541] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.482868] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.483041] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.483254] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Segment Port fc4f7a45-913f-4096-98dc-75ff9f4ef2ef not found, creating... [ 821.483474] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.483653] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.483775] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.484416] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.484636] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.485014] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.485157] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.485281] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.485502] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.485669] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.485817] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Resource: SegmentPort with ID: fc4f7a45-913f-4096-98dc-75ff9f4ef2ef is going to be created. [ 821.505770] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.505996] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.506138] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.506415] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.506665] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.506934] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "port-fc4f7a45-913f-4096-98dc-75ff9f4ef2ef" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.690786] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.691037] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.691037] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.691277] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.691370] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.691475] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8f01fd17-613c-4bd7-9c6b-8b39ac58be72 already deleted. [ 821.691554] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8f01fd17-613c-4bd7-9c6b-8b39ac58be72" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.691707] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8f01fd17-613c-4bd7-9c6b-8b39ac58be72" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.691866] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8f01fd17-613c-4bd7-9c6b-8b39ac58be72" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.691955] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8f01fd17-613c-4bd7-9c6b-8b39ac58be72',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.826242] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d4fc5f9c-09a3-4828-aeb8-f4b4a45b8375: rpc.has_security_group_logging(os_id): False [ 821.844828] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.845066] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.845149] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.845375] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.845466] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.845824] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.845894] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.845937] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.846128] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.846209] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.846317] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d4fc5f9c-09a3-4828-aeb8-f4b4a45b8375 is going to be created. [ 821.864135] env[69188]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/d4fc5f9c-09a3-4828-aeb8-f4b4a45b8375], does not exist path=[/infra/domains/default/groups/d4fc5f9c-09a3-4828-aeb8-f4b4a45b8375]."\n}' [ 821.864407] env[69188]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d4fc5f9c-09a3-4828-aeb8-f4b4a45b8375 failed to be updated, retrying after metadata refresh: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/d4fc5f9c-09a3-4828-aeb8-f4b4a45b8375 [ 821.864407] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 821.894112] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.894291] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.894393] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.894600] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.896647] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.896647] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.896886] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.896886] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.896950] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.896995] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.897233] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.897336] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.897418] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.897587] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.897663] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.897809] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d4fc5f9c-09a3-4828-aeb8-f4b4a45b8375 is going to be created. [ 821.915026] env[69188]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/d4fc5f9c-09a3-4828-aeb8-f4b4a45b8375], does not exist path=[/infra/domains/default/groups/d4fc5f9c-09a3-4828-aeb8-f4b4a45b8375]."\n}': requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/d4fc5f9c-09a3-4828-aeb8-f4b4a45b8375 [ 821.915026] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d4fc5f9c-09a3-4828-aeb8-f4b4a45b8375" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.915026] env[69188]: Traceback (most recent call last): [ 821.915026] env[69188]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 36, in wrapper [ 821.915026] env[69188]: return func(*args, **kwargs) [ 821.915026] env[69188]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 821.915026] env[69188]: res.raise_for_status() [ 821.915026] env[69188]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1024, in raise_for_status [ 821.915026] env[69188]: raise HTTPError(http_error_msg, response=self) [ 821.915026] env[69188]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/d4fc5f9c-09a3-4828-aeb8-f4b4a45b8375 [ 821.915026] env[69188]: During handling of the above exception, another exception occurred: [ 821.915026] env[69188]: Traceback (most recent call last): [ 821.915026] env[69188]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/hubs/poll.py", line 111, in wait [ 821.915026] env[69188]: listener.cb(fileno) [ 821.915026] env[69188]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py", line 272, in main [ 821.915026] env[69188]: result = function(*args, **kwargs) [ 821.915026] env[69188]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py", line 210, in security_group_rules [ 821.915026] env[69188]: self.nsx_provider.sg_rules_realize(os_sg, logged=logged) [ 821.915026] env[69188]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 1012, in sg_rules_realize [ 821.915026] env[69188]: return self._realize(Provider.SG_RULES, delete, self.payload.sg_rules_container, os_sg, provider_sg) [ 821.915026] env[69188]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 45, in wrapper [ 821.915026] env[69188]: return func(self, resource_type, delete, self.payload.sg_rules_container, os_obj, provider_sg) [ 821.915026] env[69188]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 821.915026] env[69188]: res.raise_for_status() [ 821.915026] env[69188]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1024, in raise_for_status [ 821.915026] env[69188]: raise HTTPError(http_error_msg, response=self) [ 821.915026] env[69188]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/d4fc5f9c-09a3-4828-aeb8-f4b4a45b8375 [ 821.915026] env[69188]: Removing descriptor: 5 [ 822.213311] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.213459] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.213532] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.213747] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.213875] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.213948] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8f01fd17-613c-4bd7-9c6b-8b39ac58be72 already deleted. [ 822.214053] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8f01fd17-613c-4bd7-9c6b-8b39ac58be72" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.411453] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5e76d42e-7ec6-4a5e-aa9c-c5a285d62318 in Status: SUCCESS [ 822.411453] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e76d42e-7ec6-4a5e-aa9c-c5a285d62318" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.411453] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e76d42e-7ec6-4a5e-aa9c-c5a285d62318" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.411672] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e76d42e-7ec6-4a5e-aa9c-c5a285d62318" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.411720] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.411844] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.411907] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.412068] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.413772] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.413772] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e76d42e-7ec6-4a5e-aa9c-c5a285d62318" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.413772] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5e76d42e-7ec6-4a5e-aa9c-c5a285d62318',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.555154] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d7156740-676b-417b-9850-f10d741c20bd in Status: SUCCESS [ 822.555348] env[69188]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d7156740-676b-417b-9850-f10d741c20bd deletion is rescheduled due to dependency. [ 822.555465] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d7156740-676b-417b-9850-f10d741c20bd" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.665022] env[69188]: INFO networking_nsxv3.common.synchronization [req-511dd91c-cb67-4e11-a74f-10cc3ea38c46 req-0333ef51-d288-406f-b0ee-7a0de179a005 service nova] Enqueued Resource ID: 948c6e1f-1c67-4d7c-bf02-0ca6a7c3cbda with Priority: HIGHEST for action security_group_rules [ 822.665022] env[69188]: INFO networking_nsxv3.common.synchronization [req-511dd91c-cb67-4e11-a74f-10cc3ea38c46 req-0333ef51-d288-406f-b0ee-7a0de179a005 service nova] Enqueued Resource ID: 948c6e1f-1c67-4d7c-bf02-0ca6a7c3cbda with Priority: HIGHEST for action security_group_members [ 822.665022] env[69188]: INFO networking_nsxv3.common.synchronization [req-511dd91c-cb67-4e11-a74f-10cc3ea38c46 req-0333ef51-d288-406f-b0ee-7a0de179a005 service nova] Enqueued Resource ID: fc4f7a45-913f-4096-98dc-75ff9f4ef2ef with Priority: HIGHEST for action port [ 822.665022] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 948c6e1f-1c67-4d7c-bf02-0ca6a7c3cbda with Priority: HIGHEST for action security_group_rules [ 822.665022] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 948c6e1f-1c67-4d7c-bf02-0ca6a7c3cbda with Priority: HIGHEST for action security_group_members [ 822.665022] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fc4f7a45-913f-4096-98dc-75ff9f4ef2ef with Priority: HIGHEST for action port [ 822.665022] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-948c6e1f-1c67-4d7c-bf02-0ca6a7c3cbda taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.665022] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-948c6e1f-1c67-4d7c-bf02-0ca6a7c3cbda" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.665777] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-948c6e1f-1c67-4d7c-bf02-0ca6a7c3cbda" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.666339] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-948c6e1f-1c67-4d7c-bf02-0ca6a7c3cbda" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.666552] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('948c6e1f-1c67-4d7c-bf02-0ca6a7c3cbda',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.669122] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-948c6e1f-1c67-4d7c-bf02-0ca6a7c3cbda taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.669122] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-948c6e1f-1c67-4d7c-bf02-0ca6a7c3cbda" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.669122] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-948c6e1f-1c67-4d7c-bf02-0ca6a7c3cbda" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.669122] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-948c6e1f-1c67-4d7c-bf02-0ca6a7c3cbda" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.669122] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.669122] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.669122] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.669122] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.669122] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.669122] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('948c6e1f-1c67-4d7c-bf02-0ca6a7c3cbda',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.669928] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-fc4f7a45-913f-4096-98dc-75ff9f4ef2ef taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.669928] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fc4f7a45-913f-4096-98dc-75ff9f4ef2ef" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.670059] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fc4f7a45-913f-4096-98dc-75ff9f4ef2ef" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.672180] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fc4f7a45-913f-4096-98dc-75ff9f4ef2ef" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.672180] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fc4f7a45-913f-4096-98dc-75ff9f4ef2ef',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.917913] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e76d42e-7ec6-4a5e-aa9c-c5a285d62318 taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.918235] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e76d42e-7ec6-4a5e-aa9c-c5a285d62318" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.918399] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e76d42e-7ec6-4a5e-aa9c-c5a285d62318" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.919151] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e76d42e-7ec6-4a5e-aa9c-c5a285d62318" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.919501] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.919675] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.919779] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.920234] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.920430] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.920554] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e76d42e-7ec6-4a5e-aa9c-c5a285d62318" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.920792] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e76d42e-7ec6-4a5e-aa9c-c5a285d62318 taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.921082] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e76d42e-7ec6-4a5e-aa9c-c5a285d62318" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.921216] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e76d42e-7ec6-4a5e-aa9c-c5a285d62318" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.921351] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e76d42e-7ec6-4a5e-aa9c-c5a285d62318" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.921979] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.922851] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.922851] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.922851] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.922851] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.922851] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e76d42e-7ec6-4a5e-aa9c-c5a285d62318" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.922851] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5e76d42e-7ec6-4a5e-aa9c-c5a285d62318',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.172828] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('948c6e1f-1c67-4d7c-bf02-0ca6a7c3cbda',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.174955] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-948c6e1f-1c67-4d7c-bf02-0ca6a7c3cbda taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.174955] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-948c6e1f-1c67-4d7c-bf02-0ca6a7c3cbda" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.177991] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fc4f7a45-913f-4096-98dc-75ff9f4ef2ef with status ACTIVE [ 823.179527] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.179762] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.179897] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.182193] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.182193] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.182193] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.182193] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.182193] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.182193] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.182193] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.182193] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.182193] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.182193] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.182193] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.182193] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.182193] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fc4f7a45-913f-4096-98dc-75ff9f4ef2ef is going to be updated. [ 823.204516] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.204766] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.204766] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.205107] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.205339] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.205443] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fc4f7a45-913f-4096-98dc-75ff9f4ef2ef" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.337150] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 44c5b379-bd5b-44a8-ad31-bc9a9b51d60e in Status: SUCCESS [ 823.337434] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-44c5b379-bd5b-44a8-ad31-bc9a9b51d60e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.337603] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-44c5b379-bd5b-44a8-ad31-bc9a9b51d60e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.338659] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-44c5b379-bd5b-44a8-ad31-bc9a9b51d60e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.338944] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.339097] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.339177] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.339347] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.339432] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.339516] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-44c5b379-bd5b-44a8-ad31-bc9a9b51d60e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.339614] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('44c5b379-bd5b-44a8-ad31-bc9a9b51d60e',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.341396] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-44c5b379-bd5b-44a8-ad31-bc9a9b51d60e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.341563] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-44c5b379-bd5b-44a8-ad31-bc9a9b51d60e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.341727] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.341832] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.341896] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.342072] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.342169] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.342261] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('44c5b379-bd5b-44a8-ad31-bc9a9b51d60e',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.426073] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5e76d42e-7ec6-4a5e-aa9c-c5a285d62318: rpc.has_security_group_logging(os_id): False [ 823.447033] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.447033] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.447033] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.447033] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.464957] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.465366] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.465502] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.465502] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.466085] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.466085] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.466085] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.466368] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.466368] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.466368] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.466546] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.466625] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.466753] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.466821] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.466994] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.467145] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.467255] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5e76d42e-7ec6-4a5e-aa9c-c5a285d62318 is going to be updated. [ 823.527885] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.527885] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.527885] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.528552] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.528552] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.545765] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5e76d42e-7ec6-4a5e-aa9c-c5a285d62318 in Status: IN_PROGRESS for 2s [ 823.675294] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('948c6e1f-1c67-4d7c-bf02-0ca6a7c3cbda',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.844357] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-44c5b379-bd5b-44a8-ad31-bc9a9b51d60e taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.844357] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-44c5b379-bd5b-44a8-ad31-bc9a9b51d60e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.849965] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('44c5b379-bd5b-44a8-ad31-bc9a9b51d60e',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.155184] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.155541] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.155541] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.155733] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.155877] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.177885] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.178088] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.178135] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.178349] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.178437] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.178536] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 948c6e1f-1c67-4d7c-bf02-0ca6a7c3cbda is going to be created. [ 824.206646] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.206898] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.207049] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.207316] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.208863] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.220305] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 948c6e1f-1c67-4d7c-bf02-0ca6a7c3cbda in Status: UNINITIALIZED for 2s [ 824.351058] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('44c5b379-bd5b-44a8-ad31-bc9a9b51d60e',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.658712] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.854048] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.854216] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.854216] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.854380] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.854484] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.854578] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 44c5b379-bd5b-44a8-ad31-bc9a9b51d60e is going to be updated. [ 824.881935] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.882690] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.882783] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.882999] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.883152] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.897934] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 44c5b379-bd5b-44a8-ad31-bc9a9b51d60e in Status: IN_PROGRESS for 2s [ 825.162671] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.562022] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5e76d42e-7ec6-4a5e-aa9c-c5a285d62318 in Status: SUCCESS [ 825.562022] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5e76d42e-7ec6-4a5e-aa9c-c5a285d62318" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.668060] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 825.668193] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 826.231816] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 948c6e1f-1c67-4d7c-bf02-0ca6a7c3cbda in Status: SUCCESS [ 826.232745] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-948c6e1f-1c67-4d7c-bf02-0ca6a7c3cbda" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.232745] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-948c6e1f-1c67-4d7c-bf02-0ca6a7c3cbda" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.232745] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-948c6e1f-1c67-4d7c-bf02-0ca6a7c3cbda" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.233137] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.233137] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.233137] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.233337] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.233387] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.233462] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-948c6e1f-1c67-4d7c-bf02-0ca6a7c3cbda" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.233571] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('948c6e1f-1c67-4d7c-bf02-0ca6a7c3cbda',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.342575] env[69188]: INFO networking_nsxv3.common.synchronization [req-4538bad9-51a5-4cab-9bf3-275abe4dd487 req-e27aa364-88ad-4ad7-bff5-17794a11e62b tempest-ServerGroupTestJSON-1011282019 tempest-ServerGroupTestJSON-1011282019-project-member] Enqueued Resource ID: c1b8ce61-c092-47d3-9c53-192ccca5ff8d with Priority: HIGHEST for action security_group_members [ 826.343427] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c1b8ce61-c092-47d3-9c53-192ccca5ff8d with Priority: HIGHEST for action security_group_members [ 826.343753] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-c1b8ce61-c092-47d3-9c53-192ccca5ff8d taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.343898] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c1b8ce61-c092-47d3-9c53-192ccca5ff8d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.343963] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c1b8ce61-c092-47d3-9c53-192ccca5ff8d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.344712] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c1b8ce61-c092-47d3-9c53-192ccca5ff8d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.344712] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.344712] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.344712] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.344712] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.344996] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.344996] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c1b8ce61-c092-47d3-9c53-192ccca5ff8d',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.460264] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.460449] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.460527] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.460856] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.478460] env[69188]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 826.479897] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.480960] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 826.508864] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.509112] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.509112] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.509331] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.515260] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.515840] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 826.515931] env[69188]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=69188) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 826.516023] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 826.549020] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.552587] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.552587] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.552587] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.552587] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.552587] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 826.605157] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.605157] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.605332] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.605430] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.605651] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.605862] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 826.661937] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.663273] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.663273] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.663702] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.664113] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.664414] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:32. [ 826.664554] env[69188]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'43255fe7-9062-49a0-a8ff-2aab46177272', '345a1564-5c47-4d81-9096-66a6ad96570a', '2dad819d-4da9-4798-827e-298c399b35c5', '8960cdd5-264d-45ae-a581-3531272dfbaa', 'd7156740-676b-417b-9850-f10d741c20bd', '199db626-eef5-4a20-b92a-585841c1cff4', 'c1b8ce61-c092-47d3-9c53-192ccca5ff8d', '397559b2-3c5a-424d-b09d-43a25d2abba6', 'ec45d27b-caa2-4488-8317-d6595de404b8', 'e2f14ed1-21b8-4d1e-b6bc-559e167b9967', 'b8569476-f644-46f4-87dc-5a1d19af31a2', '5ad89469-8ec8-4f86-aa6c-a6f4c7596c0b', 'eb8c8265-ddd7-41a1-a435-066f89c523e5', '7f98bc00-dbd3-411c-a67a-14369145489a', 'e1f5743d-088c-4b6d-9680-d1a339199c95', '9f2518e8-b195-4520-b262-caa765ab7e27', '3cd8cf7d-5793-4464-821e-78828cb956a9', '143fbb10-efe2-4f17-a012-d41cc9b595b6', 'cd207b0a-02a6-4378-9240-c9d49160b653', '44c5b379-bd5b-44a8-ad31-bc9a9b51d60e', 'c019210a-f261-4200-a6cd-a6e2fc4f9396', '86b3e666-35a3-418a-82c9-eb305c030ea1', '5e76d42e-7ec6-4a5e-aa9c-c5a285d62318', '9482bec7-7d68-4fe1-8d77-d380c3f6dc7a', '460ab751-c0ea-45e9-bf76-9a767798212b', '53b2b927-2e3d-4111-b25a-7b34ab9fa28d', '55dcb887-f0db-4969-b757-e829798327eb', 'dbff1afa-14ec-4fad-8985-0fb6140d58bb', '9d153fe4-605f-47fe-a33b-9d019b977fa7', '614b9fd7-ab13-4673-ace1-c5f03c5b9acc', '4e9db3bb-e903-42d7-b7e6-e365ea0c7f5f', '24a7b083-b432-46d6-94de-76adf6ce22b3'} {{(pid=69188) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 826.664923] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 826.684189] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.684457] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.684457] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.684674] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.684794] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.684952] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 826.685045] env[69188]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=69188) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 826.685132] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 826.736363] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-948c6e1f-1c67-4d7c-bf02-0ca6a7c3cbda taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.736535] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-948c6e1f-1c67-4d7c-bf02-0ca6a7c3cbda" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.736635] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-948c6e1f-1c67-4d7c-bf02-0ca6a7c3cbda" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.736839] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-948c6e1f-1c67-4d7c-bf02-0ca6a7c3cbda" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.737044] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.737142] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.737197] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.741020] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.741020] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.741020] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-948c6e1f-1c67-4d7c-bf02-0ca6a7c3cbda" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.741020] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-948c6e1f-1c67-4d7c-bf02-0ca6a7c3cbda taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.741020] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-948c6e1f-1c67-4d7c-bf02-0ca6a7c3cbda" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.741020] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-948c6e1f-1c67-4d7c-bf02-0ca6a7c3cbda" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.741020] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-948c6e1f-1c67-4d7c-bf02-0ca6a7c3cbda" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.741020] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.741020] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.741020] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.741020] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.741020] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.741020] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-948c6e1f-1c67-4d7c-bf02-0ca6a7c3cbda" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.741020] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('948c6e1f-1c67-4d7c-bf02-0ca6a7c3cbda',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.805515] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.805657] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.805833] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.805952] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.806665] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.806886] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 826.806964] env[69188]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=69188) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 826.807267] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 826.807692] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 826.807692] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/32 resources of Type:Security Group Rules [ 826.807692] env[69188]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 43255fe7-9062-49a0-a8ff-2aab46177272 with Priority: HIGH for action security_group_rules [ 826.807692] env[69188]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 345a1564-5c47-4d81-9096-66a6ad96570a with Priority: HIGH for action security_group_rules [ 826.807692] env[69188]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 2dad819d-4da9-4798-827e-298c399b35c5 with Priority: HIGH for action security_group_rules [ 826.807891] env[69188]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 8960cdd5-264d-45ae-a581-3531272dfbaa with Priority: HIGH for action security_group_rules [ 826.807891] env[69188]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d7156740-676b-417b-9850-f10d741c20bd with Priority: HIGH for action security_group_rules [ 826.807891] env[69188]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 199db626-eef5-4a20-b92a-585841c1cff4 with Priority: HIGH for action security_group_rules [ 826.808050] env[69188]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c1b8ce61-c092-47d3-9c53-192ccca5ff8d with Priority: HIGH for action security_group_rules [ 826.808050] env[69188]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 397559b2-3c5a-424d-b09d-43a25d2abba6 with Priority: HIGH for action security_group_rules [ 826.808140] env[69188]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ec45d27b-caa2-4488-8317-d6595de404b8 with Priority: HIGH for action security_group_rules [ 826.808140] env[69188]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e2f14ed1-21b8-4d1e-b6bc-559e167b9967 with Priority: HIGH for action security_group_rules [ 826.808234] env[69188]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b8569476-f644-46f4-87dc-5a1d19af31a2 with Priority: HIGH for action security_group_rules [ 826.808234] env[69188]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 5ad89469-8ec8-4f86-aa6c-a6f4c7596c0b with Priority: HIGH for action security_group_rules [ 826.808301] env[69188]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: eb8c8265-ddd7-41a1-a435-066f89c523e5 with Priority: HIGH for action security_group_rules [ 826.809961] env[69188]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7f98bc00-dbd3-411c-a67a-14369145489a with Priority: HIGH for action security_group_rules [ 826.809961] env[69188]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e1f5743d-088c-4b6d-9680-d1a339199c95 with Priority: HIGH for action security_group_rules [ 826.809961] env[69188]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9f2518e8-b195-4520-b262-caa765ab7e27 with Priority: HIGH for action security_group_rules [ 826.809961] env[69188]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 3cd8cf7d-5793-4464-821e-78828cb956a9 with Priority: HIGH for action security_group_rules [ 826.809961] env[69188]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 143fbb10-efe2-4f17-a012-d41cc9b595b6 with Priority: HIGH for action security_group_rules [ 826.809961] env[69188]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: cd207b0a-02a6-4378-9240-c9d49160b653 with Priority: HIGH for action security_group_rules [ 826.809961] env[69188]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 44c5b379-bd5b-44a8-ad31-bc9a9b51d60e with Priority: HIGH for action security_group_rules [ 826.809961] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.847563] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.847728] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.847822] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.848063] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.866328] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.866851] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.866851] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.866851] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.866851] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.866851] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.867144] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c1b8ce61-c092-47d3-9c53-192ccca5ff8d is going to be updated. [ 826.891937] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.892164] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.892238] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.892494] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.892639] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.901173] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c1b8ce61-c092-47d3-9c53-192ccca5ff8d in Status: IN_PROGRESS for 2s [ 826.904945] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 44c5b379-bd5b-44a8-ad31-bc9a9b51d60e in Status: SUCCESS [ 826.905214] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-44c5b379-bd5b-44a8-ad31-bc9a9b51d60e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.906027] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-44c5b379-bd5b-44a8-ad31-bc9a9b51d60e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.906027] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-44c5b379-bd5b-44a8-ad31-bc9a9b51d60e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.906027] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.906027] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.906027] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.906027] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.906364] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.906364] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('44c5b379-bd5b-44a8-ad31-bc9a9b51d60e',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.173088] env[69188]: INFO networking_nsxv3.common.synchronization [req-1474bd15-a950-4aa7-90a5-647e554b6c3e req-089df035-aed7-4076-bf07-3d3892b1fd7d tempest-ServerDiskConfigTestJSON-1476779099 tempest-ServerDiskConfigTestJSON-1476779099-project-member] Enqueued Resource ID: 24a7b083-b432-46d6-94de-76adf6ce22b3 with Priority: HIGHEST for action security_group_members [ 827.173088] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 24a7b083-b432-46d6-94de-76adf6ce22b3 with Priority: HIGHEST for action security_group_members [ 827.173088] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 43255fe7-9062-49a0-a8ff-2aab46177272 with Priority: HIGH for action security_group_rules [ 827.173088] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2dad819d-4da9-4798-827e-298c399b35c5 with Priority: HIGH for action security_group_rules [ 827.173088] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c1b8ce61-c092-47d3-9c53-192ccca5ff8d with Priority: HIGH for action security_group_rules [ 827.173088] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e1f5743d-088c-4b6d-9680-d1a339199c95 with Priority: HIGH for action security_group_rules [ 827.173871] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 44c5b379-bd5b-44a8-ad31-bc9a9b51d60e with Priority: HIGH for action security_group_rules [ 827.174340] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cd207b0a-02a6-4378-9240-c9d49160b653 with Priority: HIGH for action security_group_rules [ 827.175126] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 143fbb10-efe2-4f17-a012-d41cc9b595b6 with Priority: HIGH for action security_group_rules [ 827.175383] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3cd8cf7d-5793-4464-821e-78828cb956a9 with Priority: HIGH for action security_group_rules [ 827.175587] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f98bc00-dbd3-411c-a67a-14369145489a with Priority: HIGH for action security_group_rules [ 827.175793] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f2518e8-b195-4520-b262-caa765ab7e27 with Priority: HIGH for action security_group_rules [ 827.176873] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eb8c8265-ddd7-41a1-a435-066f89c523e5 with Priority: HIGH for action security_group_rules [ 827.177197] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5ad89469-8ec8-4f86-aa6c-a6f4c7596c0b with Priority: HIGH for action security_group_rules [ 827.177565] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8569476-f644-46f4-87dc-5a1d19af31a2 with Priority: HIGH for action security_group_rules [ 827.178245] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2f14ed1-21b8-4d1e-b6bc-559e167b9967 with Priority: HIGH for action security_group_rules [ 827.180020] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ec45d27b-caa2-4488-8317-d6595de404b8 with Priority: HIGH for action security_group_rules [ 827.180020] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 199db626-eef5-4a20-b92a-585841c1cff4 with Priority: HIGH for action security_group_rules [ 827.180020] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 397559b2-3c5a-424d-b09d-43a25d2abba6 with Priority: HIGH for action security_group_rules [ 827.180020] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d7156740-676b-417b-9850-f10d741c20bd with Priority: HIGH for action security_group_rules [ 827.180020] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 345a1564-5c47-4d81-9096-66a6ad96570a with Priority: HIGH for action security_group_rules [ 827.180020] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8960cdd5-264d-45ae-a581-3531272dfbaa with Priority: HIGH for action security_group_rules [ 827.180020] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-24a7b083-b432-46d6-94de-76adf6ce22b3 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.180020] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-24a7b083-b432-46d6-94de-76adf6ce22b3" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.180020] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-24a7b083-b432-46d6-94de-76adf6ce22b3" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.180020] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-24a7b083-b432-46d6-94de-76adf6ce22b3" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.180020] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.180726] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.180929] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.181224] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.181421] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.181603] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('24a7b083-b432-46d6-94de-76adf6ce22b3',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.183757] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-43255fe7-9062-49a0-a8ff-2aab46177272 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.183757] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-43255fe7-9062-49a0-a8ff-2aab46177272" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.183757] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-43255fe7-9062-49a0-a8ff-2aab46177272" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.183757] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-43255fe7-9062-49a0-a8ff-2aab46177272" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.183757] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('43255fe7-9062-49a0-a8ff-2aab46177272',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.184659] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2dad819d-4da9-4798-827e-298c399b35c5 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.184782] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2dad819d-4da9-4798-827e-298c399b35c5" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.184856] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2dad819d-4da9-4798-827e-298c399b35c5" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.189082] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2dad819d-4da9-4798-827e-298c399b35c5" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.189256] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2dad819d-4da9-4798-827e-298c399b35c5',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.190303] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c1b8ce61-c092-47d3-9c53-192ccca5ff8d taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.190452] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c1b8ce61-c092-47d3-9c53-192ccca5ff8d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.190522] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c1b8ce61-c092-47d3-9c53-192ccca5ff8d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.190728] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c1b8ce61-c092-47d3-9c53-192ccca5ff8d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.190839] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c1b8ce61-c092-47d3-9c53-192ccca5ff8d',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.192488] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e1f5743d-088c-4b6d-9680-d1a339199c95 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.192627] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e1f5743d-088c-4b6d-9680-d1a339199c95" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.192701] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e1f5743d-088c-4b6d-9680-d1a339199c95" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.192905] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e1f5743d-088c-4b6d-9680-d1a339199c95" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.192985] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e1f5743d-088c-4b6d-9680-d1a339199c95',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.194223] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-44c5b379-bd5b-44a8-ad31-bc9a9b51d60e taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.196381] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-44c5b379-bd5b-44a8-ad31-bc9a9b51d60e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.196381] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cd207b0a-02a6-4378-9240-c9d49160b653 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.196381] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cd207b0a-02a6-4378-9240-c9d49160b653" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.196381] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cd207b0a-02a6-4378-9240-c9d49160b653" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.196381] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cd207b0a-02a6-4378-9240-c9d49160b653" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.196381] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cd207b0a-02a6-4378-9240-c9d49160b653',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.196971] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-143fbb10-efe2-4f17-a012-d41cc9b595b6 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.196971] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-143fbb10-efe2-4f17-a012-d41cc9b595b6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.196971] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-143fbb10-efe2-4f17-a012-d41cc9b595b6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.197237] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-143fbb10-efe2-4f17-a012-d41cc9b595b6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.197237] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('143fbb10-efe2-4f17-a012-d41cc9b595b6',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.199036] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3cd8cf7d-5793-4464-821e-78828cb956a9 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.199036] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3cd8cf7d-5793-4464-821e-78828cb956a9" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.199036] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3cd8cf7d-5793-4464-821e-78828cb956a9" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.199036] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3cd8cf7d-5793-4464-821e-78828cb956a9" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.199036] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3cd8cf7d-5793-4464-821e-78828cb956a9',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.202044] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7f98bc00-dbd3-411c-a67a-14369145489a taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.202296] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7f98bc00-dbd3-411c-a67a-14369145489a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.202296] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7f98bc00-dbd3-411c-a67a-14369145489a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.202472] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7f98bc00-dbd3-411c-a67a-14369145489a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.202528] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7f98bc00-dbd3-411c-a67a-14369145489a',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.203273] env[69188]: WARNING oslo_messaging._drivers.amqpdriver [-] Number of call queues is 11, greater than warning threshold: 10. There could be a leak. Increasing threshold to: 20 [ 827.204386] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9f2518e8-b195-4520-b262-caa765ab7e27 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.204386] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9f2518e8-b195-4520-b262-caa765ab7e27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.204386] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9f2518e8-b195-4520-b262-caa765ab7e27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.204386] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9f2518e8-b195-4520-b262-caa765ab7e27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.204386] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9f2518e8-b195-4520-b262-caa765ab7e27',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.205714] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-eb8c8265-ddd7-41a1-a435-066f89c523e5 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.205714] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-eb8c8265-ddd7-41a1-a435-066f89c523e5" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.205714] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-eb8c8265-ddd7-41a1-a435-066f89c523e5" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.205714] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-eb8c8265-ddd7-41a1-a435-066f89c523e5" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.205714] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('eb8c8265-ddd7-41a1-a435-066f89c523e5',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.206791] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5ad89469-8ec8-4f86-aa6c-a6f4c7596c0b taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.206910] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5ad89469-8ec8-4f86-aa6c-a6f4c7596c0b" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.207194] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5ad89469-8ec8-4f86-aa6c-a6f4c7596c0b" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.207194] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5ad89469-8ec8-4f86-aa6c-a6f4c7596c0b" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.207194] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5ad89469-8ec8-4f86-aa6c-a6f4c7596c0b',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.209042] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b8569476-f644-46f4-87dc-5a1d19af31a2 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.209042] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b8569476-f644-46f4-87dc-5a1d19af31a2" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.209042] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b8569476-f644-46f4-87dc-5a1d19af31a2" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.209042] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b8569476-f644-46f4-87dc-5a1d19af31a2" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.209042] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b8569476-f644-46f4-87dc-5a1d19af31a2',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.211071] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e2f14ed1-21b8-4d1e-b6bc-559e167b9967 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.211071] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e2f14ed1-21b8-4d1e-b6bc-559e167b9967" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.211071] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e2f14ed1-21b8-4d1e-b6bc-559e167b9967" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.211071] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e2f14ed1-21b8-4d1e-b6bc-559e167b9967" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.211071] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e2f14ed1-21b8-4d1e-b6bc-559e167b9967',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.214255] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ec45d27b-caa2-4488-8317-d6595de404b8 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.215254] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ec45d27b-caa2-4488-8317-d6595de404b8" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.215254] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ec45d27b-caa2-4488-8317-d6595de404b8" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.215254] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ec45d27b-caa2-4488-8317-d6595de404b8" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.215254] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ec45d27b-caa2-4488-8317-d6595de404b8',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.216072] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-199db626-eef5-4a20-b92a-585841c1cff4 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.216459] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-199db626-eef5-4a20-b92a-585841c1cff4" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.216459] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-199db626-eef5-4a20-b92a-585841c1cff4" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.216459] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-199db626-eef5-4a20-b92a-585841c1cff4" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.216598] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('199db626-eef5-4a20-b92a-585841c1cff4',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.217609] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-397559b2-3c5a-424d-b09d-43a25d2abba6 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.218242] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-397559b2-3c5a-424d-b09d-43a25d2abba6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.218242] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-397559b2-3c5a-424d-b09d-43a25d2abba6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.218452] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-397559b2-3c5a-424d-b09d-43a25d2abba6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.218818] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('397559b2-3c5a-424d-b09d-43a25d2abba6',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.220223] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d7156740-676b-417b-9850-f10d741c20bd taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.220993] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d7156740-676b-417b-9850-f10d741c20bd" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.221094] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d7156740-676b-417b-9850-f10d741c20bd" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.221343] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d7156740-676b-417b-9850-f10d741c20bd" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.221426] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d7156740-676b-417b-9850-f10d741c20bd',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.222645] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-345a1564-5c47-4d81-9096-66a6ad96570a taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.222777] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-345a1564-5c47-4d81-9096-66a6ad96570a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.222777] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-345a1564-5c47-4d81-9096-66a6ad96570a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.222994] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-345a1564-5c47-4d81-9096-66a6ad96570a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.223071] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('345a1564-5c47-4d81-9096-66a6ad96570a',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.223498] env[69188]: WARNING oslo_messaging._drivers.amqpdriver [-] Number of call queues is 21, greater than warning threshold: 20. There could be a leak. Increasing threshold to: 40 [ 827.224386] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8960cdd5-264d-45ae-a581-3531272dfbaa taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.224512] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8960cdd5-264d-45ae-a581-3531272dfbaa" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.224579] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8960cdd5-264d-45ae-a581-3531272dfbaa" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.224889] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8960cdd5-264d-45ae-a581-3531272dfbaa" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.224889] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8960cdd5-264d-45ae-a581-3531272dfbaa',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.229787] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.229947] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.230029] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.230281] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.231919] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-2dad819d-4da9-4798-827e-298c399b35c5 taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.232845] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2dad819d-4da9-4798-827e-298c399b35c5" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.232845] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2dad819d-4da9-4798-827e-298c399b35c5" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.232845] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2dad819d-4da9-4798-827e-298c399b35c5" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.232845] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.232845] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.232845] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.232845] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.232845] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.232845] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2dad819d-4da9-4798-827e-298c399b35c5" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.233444] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2dad819d-4da9-4798-827e-298c399b35c5',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.235140] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-43255fe7-9062-49a0-a8ff-2aab46177272 taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.235140] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-43255fe7-9062-49a0-a8ff-2aab46177272" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.235140] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-43255fe7-9062-49a0-a8ff-2aab46177272" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.235422] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-43255fe7-9062-49a0-a8ff-2aab46177272" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.235476] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.235574] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.235574] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.235792] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.235911] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.236018] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-43255fe7-9062-49a0-a8ff-2aab46177272" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.236747] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('43255fe7-9062-49a0-a8ff-2aab46177272',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.242686] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 948c6e1f-1c67-4d7c-bf02-0ca6a7c3cbda: rpc.has_security_group_logging(os_id): False [ 827.269105] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.269237] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.273455] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.273672] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.273811] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.273880] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.274085] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.274174] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.274267] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 24a7b083-b432-46d6-94de-76adf6ce22b3 is going to be updated. [ 827.275496] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.275696] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.275785] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.275988] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.276127] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.276187] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.276337] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.276443] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.276853] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.276952] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.277030] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.277181] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.277312] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.277439] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.277531] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.277593] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.277905] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.277977] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.278093] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 948c6e1f-1c67-4d7c-bf02-0ca6a7c3cbda is going to be created. [ 827.323025] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.323025] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.323025] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.323276] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.326022] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.338230] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 24a7b083-b432-46d6-94de-76adf6ce22b3 in Status: IN_PROGRESS for 2s [ 827.352124] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.352312] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.352366] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.352662] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.352898] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.369486] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 948c6e1f-1c67-4d7c-bf02-0ca6a7c3cbda in Status: IN_PROGRESS for 2s [ 827.411115] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('44c5b379-bd5b-44a8-ad31-bc9a9b51d60e',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.581085] env[69188]: INFO networking_nsxv3.common.synchronization [req-c2f4330f-f23e-45af-b8e3-e7dd9626799d req-997967bc-0adf-4907-ad42-14cfac9974ef tempest-ServerRescueTestJSONUnderV235-1972914019 tempest-ServerRescueTestJSONUnderV235-1972914019-project-member] Enqueued Resource ID: 44c5b379-bd5b-44a8-ad31-bc9a9b51d60e with Priority: HIGHEST for action security_group_members [ 827.582041] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 44c5b379-bd5b-44a8-ad31-bc9a9b51d60e with Priority: HIGHEST for action security_group_members [ 827.582041] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-44c5b379-bd5b-44a8-ad31-bc9a9b51d60e taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.582278] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-44c5b379-bd5b-44a8-ad31-bc9a9b51d60e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.733279] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock network-907 taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.733490] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "network-907" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.735304] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "network-907" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.735773] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "network-907" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.736112] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.736375] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.736436] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.736633] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.736794] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.736992] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 827.737123] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] NeedRegenerationException {{(pid=69188) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 827.737231] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] no value, waiting for create lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 827.737336] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] value creation lock acquired {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 827.737447] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 827.737553] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Calling creation function for not-yet-present value {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 827.737693] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 827.741300] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('43255fe7-9062-49a0-a8ff-2aab46177272',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.743717] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2dad819d-4da9-4798-827e-298c399b35c5',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.773304] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-143fbb10-efe2-4f17-a012-d41cc9b595b6 taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.773440] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-143fbb10-efe2-4f17-a012-d41cc9b595b6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.773531] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-143fbb10-efe2-4f17-a012-d41cc9b595b6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.773788] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-143fbb10-efe2-4f17-a012-d41cc9b595b6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.773865] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.773957] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.774040] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.774188] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.774275] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.774361] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-143fbb10-efe2-4f17-a012-d41cc9b595b6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.774449] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('143fbb10-efe2-4f17-a012-d41cc9b595b6',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.784537] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-199db626-eef5-4a20-b92a-585841c1cff4 taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.784656] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-199db626-eef5-4a20-b92a-585841c1cff4" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.784724] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-199db626-eef5-4a20-b92a-585841c1cff4" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.784912] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-199db626-eef5-4a20-b92a-585841c1cff4" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.785163] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.785264] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.785450] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.785511] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.786397] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.786397] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-199db626-eef5-4a20-b92a-585841c1cff4" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.786397] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('199db626-eef5-4a20-b92a-585841c1cff4',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.789058] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-345a1564-5c47-4d81-9096-66a6ad96570a taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.789172] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-345a1564-5c47-4d81-9096-66a6ad96570a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.789252] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-345a1564-5c47-4d81-9096-66a6ad96570a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.789435] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-345a1564-5c47-4d81-9096-66a6ad96570a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.789591] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.789684] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.789761] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.790090] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.790090] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.790090] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-345a1564-5c47-4d81-9096-66a6ad96570a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.790274] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('345a1564-5c47-4d81-9096-66a6ad96570a',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.800598] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 827.800907] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Cache value generated in 0.063 seconds for key(s): 'zone-id' {{(pid=69188) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 827.800963] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Released creation lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 827.801195] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "network-907" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.801623] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock port-0f2aa834-fd15-40eb-aa22-447569332526 taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.801861] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "port-0f2aa834-fd15-40eb-aa22-447569332526" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.803112] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "port-0f2aa834-fd15-40eb-aa22-447569332526" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.803112] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "port-0f2aa834-fd15-40eb-aa22-447569332526" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.803112] env[69188]: DEBUG networking_nsxv3.api.rpc [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0f2aa834-fd15-40eb-aa22-447569332526',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.806983] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-9f2518e8-b195-4520-b262-caa765ab7e27 taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.807110] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9f2518e8-b195-4520-b262-caa765ab7e27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.807170] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9f2518e8-b195-4520-b262-caa765ab7e27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.807381] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9f2518e8-b195-4520-b262-caa765ab7e27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.807765] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.807765] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.807765] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.808489] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.808489] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.808576] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9f2518e8-b195-4520-b262-caa765ab7e27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.808639] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9f2518e8-b195-4520-b262-caa765ab7e27',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.811541] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-cd207b0a-02a6-4378-9240-c9d49160b653 taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.811688] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cd207b0a-02a6-4378-9240-c9d49160b653" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.811783] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cd207b0a-02a6-4378-9240-c9d49160b653" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.811963] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cd207b0a-02a6-4378-9240-c9d49160b653" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.812137] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.812277] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.812317] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.812426] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.812542] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.812591] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cd207b0a-02a6-4378-9240-c9d49160b653" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.812932] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cd207b0a-02a6-4378-9240-c9d49160b653',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.844144] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.844144] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.844144] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.844387] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.848075] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.848075] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.848075] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.848075] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.851112] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.851112] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.851112] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.851112] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.856379] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.856491] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.857353] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.857441] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.858534] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.858534] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.859089] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.859165] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.863572] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.863572] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.863572] env[69188]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 827.863930] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.863930] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.864626] env[69188]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 827.865660] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.865660] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.866711] env[69188]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 827.867207] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.867254] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: eb8c8265-ddd7-41a1-a435-066f89c523e5 is going to be deleted. [ 827.868370] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.868628] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.884232] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.884790] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e2f14ed1-21b8-4d1e-b6bc-559e167b9967 is going to be deleted. [ 827.886107] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.886625] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.912625] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('44c5b379-bd5b-44a8-ad31-bc9a9b51d60e',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.916782] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.916927] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7f98bc00-dbd3-411c-a67a-14369145489a is going to be deleted. [ 827.921441] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.921581] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.931885] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.932070] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.945492] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.945492] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5ad89469-8ec8-4f86-aa6c-a6f4c7596c0b is going to be deleted. [ 827.947560] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.947560] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.948922] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.949040] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.980851] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.980966] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8960cdd5-264d-45ae-a581-3531272dfbaa is going to be deleted. [ 827.982104] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.982181] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.007580] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.007702] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.011944] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.011944] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.021533] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.021621] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3cd8cf7d-5793-4464-821e-78828cb956a9 is going to be deleted. [ 828.023300] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.023300] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.063640] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.063935] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.066012] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.066012] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b8569476-f644-46f4-87dc-5a1d19af31a2 is going to be deleted. [ 828.066552] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.066760] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.129546] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.129695] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.164442] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.164442] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d7156740-676b-417b-9850-f10d741c20bd is going to be deleted. [ 828.164597] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.164722] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.164841] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.164961] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c1b8ce61-c092-47d3-9c53-192ccca5ff8d is going to be deleted. [ 828.165984] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.166194] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.244722] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 43255fe7-9062-49a0-a8ff-2aab46177272: rpc.has_security_group_logging(os_id): False [ 828.246239] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2dad819d-4da9-4798-827e-298c399b35c5: rpc.has_security_group_logging(os_id): False [ 828.279227] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.279227] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.279388] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-143fbb10-efe2-4f17-a012-d41cc9b595b6 taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.279461] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-143fbb10-efe2-4f17-a012-d41cc9b595b6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.279510] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-143fbb10-efe2-4f17-a012-d41cc9b595b6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.280283] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-143fbb10-efe2-4f17-a012-d41cc9b595b6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.280283] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.280283] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.280283] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.280529] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.280529] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.280617] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-143fbb10-efe2-4f17-a012-d41cc9b595b6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.280909] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-143fbb10-efe2-4f17-a012-d41cc9b595b6 taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.280909] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-143fbb10-efe2-4f17-a012-d41cc9b595b6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.280909] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-143fbb10-efe2-4f17-a012-d41cc9b595b6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.281264] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-143fbb10-efe2-4f17-a012-d41cc9b595b6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.281504] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.281632] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.281764] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.281982] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.282319] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.282319] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-143fbb10-efe2-4f17-a012-d41cc9b595b6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.282502] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('143fbb10-efe2-4f17-a012-d41cc9b595b6',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.285354] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.285536] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 397559b2-3c5a-424d-b09d-43a25d2abba6 is going to be deleted. [ 828.287018] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.287133] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.289029] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.289357] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.297113] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-199db626-eef5-4a20-b92a-585841c1cff4 taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.297305] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-199db626-eef5-4a20-b92a-585841c1cff4" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.297368] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-199db626-eef5-4a20-b92a-585841c1cff4" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.297589] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-199db626-eef5-4a20-b92a-585841c1cff4" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.297801] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.297941] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.298033] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.298274] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.298334] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.298399] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-199db626-eef5-4a20-b92a-585841c1cff4" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.298674] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-199db626-eef5-4a20-b92a-585841c1cff4 taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.298764] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-199db626-eef5-4a20-b92a-585841c1cff4" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.299084] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-199db626-eef5-4a20-b92a-585841c1cff4" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.299084] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-199db626-eef5-4a20-b92a-585841c1cff4" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.299588] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.299588] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.299588] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.299588] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.299588] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.299785] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-199db626-eef5-4a20-b92a-585841c1cff4" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.299853] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('199db626-eef5-4a20-b92a-585841c1cff4',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.301062] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-345a1564-5c47-4d81-9096-66a6ad96570a taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.301225] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-345a1564-5c47-4d81-9096-66a6ad96570a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.301302] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-345a1564-5c47-4d81-9096-66a6ad96570a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.301525] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-345a1564-5c47-4d81-9096-66a6ad96570a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.301697] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.302153] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.302153] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.302153] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.302153] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.302399] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-345a1564-5c47-4d81-9096-66a6ad96570a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.302491] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-345a1564-5c47-4d81-9096-66a6ad96570a taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.302584] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-345a1564-5c47-4d81-9096-66a6ad96570a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.302669] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-345a1564-5c47-4d81-9096-66a6ad96570a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.302900] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-345a1564-5c47-4d81-9096-66a6ad96570a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.303180] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.303268] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.303336] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.303510] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.303611] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.303773] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-345a1564-5c47-4d81-9096-66a6ad96570a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.303813] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('345a1564-5c47-4d81-9096-66a6ad96570a',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.318891] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.319121] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.319338] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.319661] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.319826] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.319994] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Segment Port 0f2aa834-fd15-40eb-aa22-447569332526 not found, creating... [ 828.320288] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.320457] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.320583] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.320817] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.320979] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.321420] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.321592] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.321726] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.322662] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.322662] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.322662] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Resource: SegmentPort with ID: 0f2aa834-fd15-40eb-aa22-447569332526 is going to be created. [ 828.323754] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-9f2518e8-b195-4520-b262-caa765ab7e27 taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.323885] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9f2518e8-b195-4520-b262-caa765ab7e27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.323949] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9f2518e8-b195-4520-b262-caa765ab7e27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.324148] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9f2518e8-b195-4520-b262-caa765ab7e27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.324338] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.324500] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.324500] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.324645] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.324977] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.324977] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9f2518e8-b195-4520-b262-caa765ab7e27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.324977] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-9f2518e8-b195-4520-b262-caa765ab7e27 taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.325150] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9f2518e8-b195-4520-b262-caa765ab7e27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.325296] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9f2518e8-b195-4520-b262-caa765ab7e27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.325450] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9f2518e8-b195-4520-b262-caa765ab7e27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.325595] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.325710] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.325815] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.325911] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.325988] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.326086] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9f2518e8-b195-4520-b262-caa765ab7e27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.326179] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9f2518e8-b195-4520-b262-caa765ab7e27',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.327147] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cd207b0a-02a6-4378-9240-c9d49160b653',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.333962] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.334116] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.346334] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.346478] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ec45d27b-caa2-4488-8317-d6595de404b8 is going to be deleted. [ 828.347504] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.347903] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.369543] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.370058] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.370296] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.373458] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.373752] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.374060] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "port-0f2aa834-fd15-40eb-aa22-447569332526" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.376202] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.376202] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.383194] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.383194] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e1f5743d-088c-4b6d-9680-d1a339199c95 is going to be deleted. [ 828.383710] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.383952] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.384081] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.384160] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-eb8c8265-ddd7-41a1-a435-066f89c523e5" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.384306] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.384454] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.384526] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.384631] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e2f14ed1-21b8-4d1e-b6bc-559e167b9967" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.385470] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.388015] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.388297] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.388363] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7f98bc00-dbd3-411c-a67a-14369145489a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.388714] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.388714] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.388714] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.388859] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5ad89469-8ec8-4f86-aa6c-a6f4c7596c0b" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.388935] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.389092] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.389920] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.389920] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8960cdd5-264d-45ae-a581-3531272dfbaa" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.389920] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.389920] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.389920] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.389920] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3cd8cf7d-5793-4464-821e-78828cb956a9" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.389920] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.390216] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.393238] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.393332] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.423823] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.424023] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.424142] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.424504] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.424612] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.424735] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 44c5b379-bd5b-44a8-ad31-bc9a9b51d60e is going to be updated. [ 828.434846] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.435020] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.466949] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.466949] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.466949] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.466949] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.466949] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.467341] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.467341] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2dad819d-4da9-4798-827e-298c399b35c5 is going to be updated. [ 828.468691] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.468691] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.506049] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.506287] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.529758] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.529758] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.529758] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.529758] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.529758] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.529758] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.529758] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 43255fe7-9062-49a0-a8ff-2aab46177272 is going to be updated. [ 828.530121] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.530847] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.530847] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.530847] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d7156740-676b-417b-9850-f10d741c20bd" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.530847] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.531115] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.531115] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.531257] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c1b8ce61-c092-47d3-9c53-192ccca5ff8d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.531319] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.531464] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.531538] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.531648] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-397559b2-3c5a-424d-b09d-43a25d2abba6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.531774] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.531935] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.532031] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.532145] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b8569476-f644-46f4-87dc-5a1d19af31a2" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.533328] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.533533] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.533645] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.533950] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ec45d27b-caa2-4488-8317-d6595de404b8" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.555073] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.555267] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.555337] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.555548] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.555643] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.555761] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e1f5743d-088c-4b6d-9680-d1a339199c95" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.574743] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.574892] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.574992] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.575186] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.575342] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.601685] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 44c5b379-bd5b-44a8-ad31-bc9a9b51d60e in Status: IN_PROGRESS for 2s [ 828.610501] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.610649] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.610716] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.610913] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.611081] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.643961] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2dad819d-4da9-4798-827e-298c399b35c5 in Status: IN_PROGRESS for 2s [ 828.730888] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.731070] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.731126] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.731345] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.731483] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.769613] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 43255fe7-9062-49a0-a8ff-2aab46177272 in Status: IN_PROGRESS for 2s [ 828.789560] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 143fbb10-efe2-4f17-a012-d41cc9b595b6: rpc.has_security_group_logging(os_id): False [ 828.805908] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 345a1564-5c47-4d81-9096-66a6ad96570a: rpc.has_security_group_logging(os_id): False [ 828.807034] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 199db626-eef5-4a20-b92a-585841c1cff4: rpc.has_security_group_logging(os_id): False [ 828.826470] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.826624] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.826665] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.827270] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.828571] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.828674] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.829369] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.829463] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.830098] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9f2518e8-b195-4520-b262-caa765ab7e27: rpc.has_security_group_logging(os_id): False [ 828.830973] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cd207b0a-02a6-4378-9240-c9d49160b653: rpc.has_security_group_logging(os_id): False [ 828.858993] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.858993] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.858993] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.858993] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.858993] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.858993] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.859625] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.859774] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.859831] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.860064] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.860214] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.860569] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.860709] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.860817] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.861059] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.861190] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.861337] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 143fbb10-efe2-4f17-a012-d41cc9b595b6 is going to be updated. [ 828.862837] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.863089] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.867195] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.867377] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.868429] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.868598] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.912626] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.912975] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.913090] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.913090] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.913425] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.913552] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.914094] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.914094] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.914094] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.914094] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.914094] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.914661] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.914661] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.914661] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.914661] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.914661] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.914661] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 199db626-eef5-4a20-b92a-585841c1cff4 is going to be updated. [ 828.915898] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.916083] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.917622] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c1b8ce61-c092-47d3-9c53-192ccca5ff8d in Status: SUCCESS [ 828.917724] env[69188]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c1b8ce61-c092-47d3-9c53-192ccca5ff8d deletion is rescheduled due to dependency. [ 828.917858] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c1b8ce61-c092-47d3-9c53-192ccca5ff8d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.946540] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.946540] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.946540] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.946540] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.946540] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.946788] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.946978] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.946978] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.946978] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.947253] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.947253] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.947385] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.947477] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.947530] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.947634] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.947709] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.947906] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 345a1564-5c47-4d81-9096-66a6ad96570a is going to be updated. [ 828.949027] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.949207] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.982158] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.982342] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.983637] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.983897] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.984024] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.984096] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.984281] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.984361] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.984551] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.984647] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.984710] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.984916] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.984916] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.985141] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.985231] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.985282] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.985400] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.985477] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.985624] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9f2518e8-b195-4520-b262-caa765ab7e27 is going to be updated. [ 828.986622] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.986767] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.997827] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.997923] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.016874] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.017091] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.017268] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.017268] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.018069] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.018069] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.018069] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cd207b0a-02a6-4378-9240-c9d49160b653 is going to be updated. [ 829.018704] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.018901] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.019060] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.022285] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.022285] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.022285] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.035412] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 199db626-eef5-4a20-b92a-585841c1cff4 in Status: IN_PROGRESS for 2s [ 829.037931] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 143fbb10-efe2-4f17-a012-d41cc9b595b6 in Status: IN_PROGRESS for 2s [ 829.045527] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.045754] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.045754] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.045955] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.047035] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.070100] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 345a1564-5c47-4d81-9096-66a6ad96570a in Status: IN_PROGRESS for 2s [ 829.078881] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.079044] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.079106] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.079324] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.079466] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.102147] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9f2518e8-b195-4520-b262-caa765ab7e27 in Status: IN_PROGRESS for 2s [ 829.118944] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.119160] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.119248] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.119481] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.119676] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.149185] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cd207b0a-02a6-4378-9240-c9d49160b653 in Status: IN_PROGRESS for 2s [ 829.227031] env[69188]: INFO networking_nsxv3.common.synchronization [req-1474bd15-a950-4aa7-90a5-647e554b6c3e req-4f8e181e-0236-49d0-9513-6021f069335f service nova] Enqueued Resource ID: 24a7b083-b432-46d6-94de-76adf6ce22b3 with Priority: HIGHEST for action security_group_rules [ 829.227031] env[69188]: INFO networking_nsxv3.common.synchronization [req-1474bd15-a950-4aa7-90a5-647e554b6c3e req-4f8e181e-0236-49d0-9513-6021f069335f service nova] Enqueued Resource ID: 24a7b083-b432-46d6-94de-76adf6ce22b3 with Priority: HIGHEST for action security_group_members [ 829.227031] env[69188]: INFO networking_nsxv3.common.synchronization [req-1474bd15-a950-4aa7-90a5-647e554b6c3e req-4f8e181e-0236-49d0-9513-6021f069335f service nova] Enqueued Resource ID: 0f2aa834-fd15-40eb-aa22-447569332526 with Priority: HIGHEST for action port [ 829.227031] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 24a7b083-b432-46d6-94de-76adf6ce22b3 with Priority: HIGHEST for action security_group_rules [ 829.227031] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 24a7b083-b432-46d6-94de-76adf6ce22b3 with Priority: HIGHEST for action security_group_members [ 829.227031] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0f2aa834-fd15-40eb-aa22-447569332526 with Priority: HIGHEST for action port [ 829.231685] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-24a7b083-b432-46d6-94de-76adf6ce22b3 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.231685] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-24a7b083-b432-46d6-94de-76adf6ce22b3" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.231685] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-24a7b083-b432-46d6-94de-76adf6ce22b3" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.231685] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-24a7b083-b432-46d6-94de-76adf6ce22b3" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.231685] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('24a7b083-b432-46d6-94de-76adf6ce22b3',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.232461] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-24a7b083-b432-46d6-94de-76adf6ce22b3 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.232550] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-24a7b083-b432-46d6-94de-76adf6ce22b3" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.232818] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-0f2aa834-fd15-40eb-aa22-447569332526 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.232921] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0f2aa834-fd15-40eb-aa22-447569332526" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.232985] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0f2aa834-fd15-40eb-aa22-447569332526" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.233155] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0f2aa834-fd15-40eb-aa22-447569332526" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.233231] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0f2aa834-fd15-40eb-aa22-447569332526',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.355186] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 24a7b083-b432-46d6-94de-76adf6ce22b3 in Status: SUCCESS [ 829.355491] env[69188]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 24a7b083-b432-46d6-94de-76adf6ce22b3 deletion is rescheduled due to dependency. [ 829.355491] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-24a7b083-b432-46d6-94de-76adf6ce22b3" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.355640] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-24a7b083-b432-46d6-94de-76adf6ce22b3" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.355872] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-24a7b083-b432-46d6-94de-76adf6ce22b3" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.356071] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.356235] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.356279] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.356459] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.356509] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.356579] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('24a7b083-b432-46d6-94de-76adf6ce22b3',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.380777] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 948c6e1f-1c67-4d7c-bf02-0ca6a7c3cbda in Status: SUCCESS [ 829.381828] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-948c6e1f-1c67-4d7c-bf02-0ca6a7c3cbda" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.483596] env[69188]: INFO networking_nsxv3.common.synchronization [req-c0d0e7ec-9516-401d-aac7-705348de2075 req-36de2c62-fd30-43ef-838a-3fd720936ba4 tempest-ServerRescueTestJSON-1501419910 tempest-ServerRescueTestJSON-1501419910-project-member] Enqueued Resource ID: 143fbb10-efe2-4f17-a012-d41cc9b595b6 with Priority: HIGHEST for action security_group_members [ 829.484213] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 143fbb10-efe2-4f17-a012-d41cc9b595b6 with Priority: HIGHEST for action security_group_members [ 829.484562] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-143fbb10-efe2-4f17-a012-d41cc9b595b6 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.484708] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-143fbb10-efe2-4f17-a012-d41cc9b595b6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.484783] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-143fbb10-efe2-4f17-a012-d41cc9b595b6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.485035] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-143fbb10-efe2-4f17-a012-d41cc9b595b6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.485208] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.485324] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.485397] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.485578] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.485675] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.485783] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('143fbb10-efe2-4f17-a012-d41cc9b595b6',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.739036] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-24a7b083-b432-46d6-94de-76adf6ce22b3 taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.739036] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-24a7b083-b432-46d6-94de-76adf6ce22b3" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.739036] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0f2aa834-fd15-40eb-aa22-447569332526 with status ACTIVE [ 829.739036] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.739036] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.739036] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.739036] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.739036] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.739036] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.739036] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.739036] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.739036] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.739036] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.739036] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.739724] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.739724] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.739724] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.739724] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.739724] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0f2aa834-fd15-40eb-aa22-447569332526 is going to be updated. [ 829.764076] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.764554] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.764554] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.764672] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.764771] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.764941] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0f2aa834-fd15-40eb-aa22-447569332526" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.858831] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('24a7b083-b432-46d6-94de-76adf6ce22b3',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.905992] env[69188]: INFO networking_nsxv3.common.synchronization [req-b586b68a-1211-4091-89e9-a6d875ebe88d req-936eb40e-fbd0-433a-b9f0-e194155958a6 tempest-ServerActionsTestOtherB-2131451762 tempest-ServerActionsTestOtherB-2131451762-project-member] Enqueued Resource ID: 867581e0-cbbd-4108-a823-0b7c53d47c3a with Priority: HIGHEST for action security_group_members [ 829.906889] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 867581e0-cbbd-4108-a823-0b7c53d47c3a with Priority: HIGHEST for action security_group_members [ 829.907249] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-867581e0-cbbd-4108-a823-0b7c53d47c3a taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.907371] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-867581e0-cbbd-4108-a823-0b7c53d47c3a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.907437] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-867581e0-cbbd-4108-a823-0b7c53d47c3a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.907694] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-867581e0-cbbd-4108-a823-0b7c53d47c3a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.907868] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.908081] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.910386] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.910582] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.910681] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.910787] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('867581e0-cbbd-4108-a823-0b7c53d47c3a',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.988378] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('143fbb10-efe2-4f17-a012-d41cc9b595b6',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.360617] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('24a7b083-b432-46d6-94de-76adf6ce22b3',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.414757] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.414920] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.415007] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.415235] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.415329] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.415527] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.415625] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.415689] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.415874] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.415968] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.416298] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 867581e0-cbbd-4108-a823-0b7c53d47c3a already deleted. [ 830.416393] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-867581e0-cbbd-4108-a823-0b7c53d47c3a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.490845] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('143fbb10-efe2-4f17-a012-d41cc9b595b6',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.555077] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock network-154 taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.559033] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "network-154" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.559033] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "network-154" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.559033] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "network-154" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.559033] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.559033] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.559033] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.559033] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.559033] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.559033] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 830.559033] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] NeedRegenerationException {{(pid=69188) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 830.559033] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] no value, waiting for create lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 830.559033] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] value creation lock acquired {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 830.559033] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 830.559033] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Calling creation function for not-yet-present value {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 830.559033] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 830.576122] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 830.576316] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69188) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 830.576459] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Released creation lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 830.576644] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "network-154" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.576947] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock port-cfa4d1a2-50c1-420b-a75b-d6e544b8f9a3 taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.577146] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "port-cfa4d1a2-50c1-420b-a75b-d6e544b8f9a3" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.577272] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "port-cfa4d1a2-50c1-420b-a75b-d6e544b8f9a3" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.577602] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "port-cfa4d1a2-50c1-420b-a75b-d6e544b8f9a3" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.577746] env[69188]: DEBUG networking_nsxv3.api.rpc [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cfa4d1a2-50c1-420b-a75b-d6e544b8f9a3',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.615027] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 44c5b379-bd5b-44a8-ad31-bc9a9b51d60e in Status: SUCCESS [ 830.615027] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-44c5b379-bd5b-44a8-ad31-bc9a9b51d60e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.615027] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-44c5b379-bd5b-44a8-ad31-bc9a9b51d60e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.615027] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-44c5b379-bd5b-44a8-ad31-bc9a9b51d60e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.615027] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.615027] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.615027] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.615027] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.615027] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.615027] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-44c5b379-bd5b-44a8-ad31-bc9a9b51d60e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.616073] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-44c5b379-bd5b-44a8-ad31-bc9a9b51d60e taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.618029] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-44c5b379-bd5b-44a8-ad31-bc9a9b51d60e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.618029] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-44c5b379-bd5b-44a8-ad31-bc9a9b51d60e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.618029] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-44c5b379-bd5b-44a8-ad31-bc9a9b51d60e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.618029] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.618485] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.618716] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.619075] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.619348] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.619609] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-44c5b379-bd5b-44a8-ad31-bc9a9b51d60e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.619882] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('44c5b379-bd5b-44a8-ad31-bc9a9b51d60e',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.621381] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-44c5b379-bd5b-44a8-ad31-bc9a9b51d60e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.621723] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-44c5b379-bd5b-44a8-ad31-bc9a9b51d60e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.622095] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.623366] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.623366] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.623366] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.623366] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.623366] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('44c5b379-bd5b-44a8-ad31-bc9a9b51d60e',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.670268] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2dad819d-4da9-4798-827e-298c399b35c5 in Status: SUCCESS [ 830.670674] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2dad819d-4da9-4798-827e-298c399b35c5" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.782293] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 43255fe7-9062-49a0-a8ff-2aab46177272 in Status: SUCCESS [ 830.782293] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-43255fe7-9062-49a0-a8ff-2aab46177272" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.863839] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.864059] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.864172] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.864392] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.864514] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.864677] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 24a7b083-b432-46d6-94de-76adf6ce22b3 is going to be updated. [ 830.892650] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.892840] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.892932] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.893212] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.893388] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.901251] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 24a7b083-b432-46d6-94de-76adf6ce22b3 in Status: IN_PROGRESS for 2s [ 830.996890] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.996890] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.996890] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.996890] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.996890] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.996890] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 143fbb10-efe2-4f17-a012-d41cc9b595b6 is going to be updated. [ 831.023066] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.023661] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.023661] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.023661] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.024094] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.035249] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 143fbb10-efe2-4f17-a012-d41cc9b595b6 in Status: IN_PROGRESS for 2s [ 831.048418] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 199db626-eef5-4a20-b92a-585841c1cff4 in Status: SUCCESS [ 831.048663] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-199db626-eef5-4a20-b92a-585841c1cff4" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.049497] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 143fbb10-efe2-4f17-a012-d41cc9b595b6 in Status: SUCCESS [ 831.049680] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-143fbb10-efe2-4f17-a012-d41cc9b595b6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.084602] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 345a1564-5c47-4d81-9096-66a6ad96570a in Status: SUCCESS [ 831.084602] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-345a1564-5c47-4d81-9096-66a6ad96570a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.084602] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.084602] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.084602] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.084602] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.084602] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.084602] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Segment Port cfa4d1a2-50c1-420b-a75b-d6e544b8f9a3 not found, creating... [ 831.084602] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.085458] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.085737] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.086084] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.086520] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.086949] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.088953] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.088953] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.088953] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.088953] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.088953] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Resource: SegmentPort with ID: cfa4d1a2-50c1-420b-a75b-d6e544b8f9a3 is going to be created. [ 831.105295] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.105516] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.105646] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.105917] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.106232] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.106859] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "port-cfa4d1a2-50c1-420b-a75b-d6e544b8f9a3" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.113613] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9f2518e8-b195-4520-b262-caa765ab7e27 in Status: SUCCESS [ 831.113613] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9f2518e8-b195-4520-b262-caa765ab7e27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.126027] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 44c5b379-bd5b-44a8-ad31-bc9a9b51d60e: rpc.has_security_group_logging(os_id): False [ 831.127221] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.127349] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.127419] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.127640] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.151207] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.151326] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.164622] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.164622] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.164622] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.164622] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.164622] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.164622] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.165001] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 44c5b379-bd5b-44a8-ad31-bc9a9b51d60e is going to be updated. [ 831.165633] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.165884] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.165967] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.166471] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.166654] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.166712] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.167119] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.167119] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.167307] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.167378] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.167487] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.168425] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.168547] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.168802] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.169546] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.169762] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.169873] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.169980] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.170211] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 44c5b379-bd5b-44a8-ad31-bc9a9b51d60e is going to be updated. [ 831.173276] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cd207b0a-02a6-4378-9240-c9d49160b653 in Status: SUCCESS [ 831.173276] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cd207b0a-02a6-4378-9240-c9d49160b653" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.214018] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.214018] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.214018] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.214018] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.214018] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.222568] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 44c5b379-bd5b-44a8-ad31-bc9a9b51d60e in Status: IN_PROGRESS for 2s [ 831.274783] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.274973] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.275065] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.275284] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.275752] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.297094] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 44c5b379-bd5b-44a8-ad31-bc9a9b51d60e in Status: IN_PROGRESS for 2s [ 831.622291] env[69188]: INFO networking_nsxv3.common.synchronization [req-6ad9269f-3a0e-4611-9aef-44c4e9a83a20 req-6ea1c998-90a3-4cef-b35d-ca8f3a51be44 tempest-ImagesTestJSON-2034330654 tempest-ImagesTestJSON-2034330654-project-member] Enqueued Resource ID: 199db626-eef5-4a20-b92a-585841c1cff4 with Priority: HIGHEST for action security_group_members [ 831.622291] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 199db626-eef5-4a20-b92a-585841c1cff4 with Priority: HIGHEST for action security_group_members [ 831.622780] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-199db626-eef5-4a20-b92a-585841c1cff4 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.623444] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-199db626-eef5-4a20-b92a-585841c1cff4" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.623444] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-199db626-eef5-4a20-b92a-585841c1cff4" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.623444] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-199db626-eef5-4a20-b92a-585841c1cff4" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.623444] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.623642] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.623642] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.623831] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.623945] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.624075] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('199db626-eef5-4a20-b92a-585841c1cff4',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.061965] env[69188]: INFO networking_nsxv3.common.synchronization [req-b586b68a-1211-4091-89e9-a6d875ebe88d req-5b9238db-a44f-49b8-bcc9-9c56659c4e9c service nova] Enqueued Resource ID: 867581e0-cbbd-4108-a823-0b7c53d47c3a with Priority: HIGHEST for action security_group_rules [ 832.061965] env[69188]: INFO networking_nsxv3.common.synchronization [req-b586b68a-1211-4091-89e9-a6d875ebe88d req-5b9238db-a44f-49b8-bcc9-9c56659c4e9c service nova] Enqueued Resource ID: 867581e0-cbbd-4108-a823-0b7c53d47c3a with Priority: HIGHEST for action security_group_members [ 832.061965] env[69188]: INFO networking_nsxv3.common.synchronization [req-b586b68a-1211-4091-89e9-a6d875ebe88d req-5b9238db-a44f-49b8-bcc9-9c56659c4e9c service nova] Enqueued Resource ID: cfa4d1a2-50c1-420b-a75b-d6e544b8f9a3 with Priority: HIGHEST for action port [ 832.061965] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 867581e0-cbbd-4108-a823-0b7c53d47c3a with Priority: HIGHEST for action security_group_rules [ 832.061965] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 867581e0-cbbd-4108-a823-0b7c53d47c3a with Priority: HIGHEST for action security_group_members [ 832.062413] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cfa4d1a2-50c1-420b-a75b-d6e544b8f9a3 with Priority: HIGHEST for action port [ 832.062957] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-867581e0-cbbd-4108-a823-0b7c53d47c3a taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.063112] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-867581e0-cbbd-4108-a823-0b7c53d47c3a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.063184] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-867581e0-cbbd-4108-a823-0b7c53d47c3a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.063394] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-867581e0-cbbd-4108-a823-0b7c53d47c3a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.063479] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('867581e0-cbbd-4108-a823-0b7c53d47c3a',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.064889] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-867581e0-cbbd-4108-a823-0b7c53d47c3a taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.064889] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-867581e0-cbbd-4108-a823-0b7c53d47c3a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.064889] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-867581e0-cbbd-4108-a823-0b7c53d47c3a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.065083] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-867581e0-cbbd-4108-a823-0b7c53d47c3a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.065239] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.065338] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.065401] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.065549] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.065632] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.065725] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('867581e0-cbbd-4108-a823-0b7c53d47c3a',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.066700] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-cfa4d1a2-50c1-420b-a75b-d6e544b8f9a3 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.068920] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cfa4d1a2-50c1-420b-a75b-d6e544b8f9a3" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.069103] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cfa4d1a2-50c1-420b-a75b-d6e544b8f9a3" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.069212] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cfa4d1a2-50c1-420b-a75b-d6e544b8f9a3" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.070862] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cfa4d1a2-50c1-420b-a75b-d6e544b8f9a3',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.128490] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.128615] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.128615] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.128820] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.128928] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.129145] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.129248] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.129306] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.129459] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.129535] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.129622] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 199db626-eef5-4a20-b92a-585841c1cff4 is going to be updated. [ 832.171879] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.172016] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.172058] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.172250] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.172385] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.181437] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 199db626-eef5-4a20-b92a-585841c1cff4 in Status: IN_PROGRESS for 2s [ 832.536082] env[69188]: INFO networking_nsxv3.common.synchronization [req-45f9dc02-d407-4b49-8a7f-c44518e3efef req-ea7355a4-5906-4296-9007-ad5fb8c64ec4 tempest-MigrationsAdminTest-718349773 tempest-MigrationsAdminTest-718349773-project-member] Enqueued Resource ID: 345a1564-5c47-4d81-9096-66a6ad96570a with Priority: HIGHEST for action security_group_members [ 832.536878] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 345a1564-5c47-4d81-9096-66a6ad96570a with Priority: HIGHEST for action security_group_members [ 832.537025] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-345a1564-5c47-4d81-9096-66a6ad96570a taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.537112] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-345a1564-5c47-4d81-9096-66a6ad96570a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.537166] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-345a1564-5c47-4d81-9096-66a6ad96570a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.537328] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-345a1564-5c47-4d81-9096-66a6ad96570a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.537480] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.537576] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.537638] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.537785] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.537894] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.537989] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('345a1564-5c47-4d81-9096-66a6ad96570a',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.572298] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-867581e0-cbbd-4108-a823-0b7c53d47c3a taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.572541] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-867581e0-cbbd-4108-a823-0b7c53d47c3a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.572604] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('867581e0-cbbd-4108-a823-0b7c53d47c3a',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.577900] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port cfa4d1a2-50c1-420b-a75b-d6e544b8f9a3 with status ACTIVE [ 832.578161] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.578292] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.578361] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.578567] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.578901] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.578901] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.579030] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.580019] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.580262] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.580877] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.580877] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.580877] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.580877] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.581243] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.581243] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.581340] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: cfa4d1a2-50c1-420b-a75b-d6e544b8f9a3 is going to be updated. [ 832.603169] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.603751] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.603837] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.604066] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.604204] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.604360] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cfa4d1a2-50c1-420b-a75b-d6e544b8f9a3" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.913220] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 24a7b083-b432-46d6-94de-76adf6ce22b3 in Status: SUCCESS [ 832.914461] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-24a7b083-b432-46d6-94de-76adf6ce22b3" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.914461] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-24a7b083-b432-46d6-94de-76adf6ce22b3" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.914461] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-24a7b083-b432-46d6-94de-76adf6ce22b3" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.914461] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.914461] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.914461] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.914955] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.914955] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.914955] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-24a7b083-b432-46d6-94de-76adf6ce22b3" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.914955] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('24a7b083-b432-46d6-94de-76adf6ce22b3',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.040437] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('345a1564-5c47-4d81-9096-66a6ad96570a',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.044719] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 143fbb10-efe2-4f17-a012-d41cc9b595b6 in Status: SUCCESS [ 833.045051] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-143fbb10-efe2-4f17-a012-d41cc9b595b6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.084744] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('867581e0-cbbd-4108-a823-0b7c53d47c3a',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.100304] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock network-267 taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.100524] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "network-267" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.100650] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "network-267" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.101940] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "network-267" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.101940] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.101940] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.101940] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.101940] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.101940] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.102233] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 833.102233] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] NeedRegenerationException {{(pid=69188) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 833.102233] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] no value, waiting for create lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 833.102334] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] value creation lock acquired {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 833.102534] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 833.102648] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Calling creation function for not-yet-present value {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 833.102785] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 833.125285] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 833.125536] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=69188) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 833.125730] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Released creation lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 833.125898] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "network-267" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.127676] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock port-2a8565a9-d45d-46d5-bab2-f353a46b6e1c taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.127676] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "port-2a8565a9-d45d-46d5-bab2-f353a46b6e1c" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.127676] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "port-2a8565a9-d45d-46d5-bab2-f353a46b6e1c" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.127676] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "port-2a8565a9-d45d-46d5-bab2-f353a46b6e1c" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.127676] env[69188]: DEBUG networking_nsxv3.api.rpc [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2a8565a9-d45d-46d5-bab2-f353a46b6e1c',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.216320] env[69188]: INFO networking_nsxv3.common.synchronization [req-57f04129-3a09-41e8-8434-cdbbdd7dbb58 req-bfa989cc-2253-4d04-8c98-3db5afa019fc tempest-ImagesOneServerNegativeTestJSON-1186419322 tempest-ImagesOneServerNegativeTestJSON-1186419322-project-member] Enqueued Resource ID: 9d153fe4-605f-47fe-a33b-9d019b977fa7 with Priority: HIGHEST for action security_group_members [ 833.216320] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9d153fe4-605f-47fe-a33b-9d019b977fa7 with Priority: HIGHEST for action security_group_members [ 833.216320] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-9d153fe4-605f-47fe-a33b-9d019b977fa7 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.216320] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9d153fe4-605f-47fe-a33b-9d019b977fa7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.216320] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9d153fe4-605f-47fe-a33b-9d019b977fa7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.217065] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9d153fe4-605f-47fe-a33b-9d019b977fa7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.217392] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.217646] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.217807] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.218094] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.218276] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.218454] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9d153fe4-605f-47fe-a33b-9d019b977fa7',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.234300] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 44c5b379-bd5b-44a8-ad31-bc9a9b51d60e in Status: SUCCESS [ 833.234576] env[69188]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 44c5b379-bd5b-44a8-ad31-bc9a9b51d60e deletion is rescheduled due to dependency. [ 833.234699] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-44c5b379-bd5b-44a8-ad31-bc9a9b51d60e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.308786] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 44c5b379-bd5b-44a8-ad31-bc9a9b51d60e in Status: SUCCESS [ 833.309102] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-44c5b379-bd5b-44a8-ad31-bc9a9b51d60e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.309280] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-44c5b379-bd5b-44a8-ad31-bc9a9b51d60e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.309497] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-44c5b379-bd5b-44a8-ad31-bc9a9b51d60e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.309589] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('44c5b379-bd5b-44a8-ad31-bc9a9b51d60e',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.418852] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-24a7b083-b432-46d6-94de-76adf6ce22b3 taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.418852] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-24a7b083-b432-46d6-94de-76adf6ce22b3" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.418852] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-24a7b083-b432-46d6-94de-76adf6ce22b3" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.418852] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-24a7b083-b432-46d6-94de-76adf6ce22b3" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.418852] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.418852] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.418852] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.418852] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.419290] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.419290] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-24a7b083-b432-46d6-94de-76adf6ce22b3" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.419290] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-24a7b083-b432-46d6-94de-76adf6ce22b3 taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.419290] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-24a7b083-b432-46d6-94de-76adf6ce22b3" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.419473] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-24a7b083-b432-46d6-94de-76adf6ce22b3" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.419504] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-24a7b083-b432-46d6-94de-76adf6ce22b3" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.419644] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.419723] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.419771] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.419904] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.419987] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.420091] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-24a7b083-b432-46d6-94de-76adf6ce22b3" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.420168] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('24a7b083-b432-46d6-94de-76adf6ce22b3',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.542482] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('345a1564-5c47-4d81-9096-66a6ad96570a',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.588568] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.588718] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.588718] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.589375] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.589375] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.589528] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 867581e0-cbbd-4108-a823-0b7c53d47c3a is going to be created. [ 833.614419] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.614650] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.614758] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.615108] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.615337] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.626819] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 867581e0-cbbd-4108-a823-0b7c53d47c3a in Status: UNINITIALIZED for 2s [ 833.631761] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.632150] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.632446] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.632759] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.633029] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.633274] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Segment Port 2a8565a9-d45d-46d5-bab2-f353a46b6e1c not found, creating... [ 833.633682] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.633925] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.634136] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.634479] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.635052] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.635151] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.635401] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.635588] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.635919] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.636146] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.636370] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Resource: SegmentPort with ID: 2a8565a9-d45d-46d5-bab2-f353a46b6e1c is going to be created. [ 833.656607] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.656834] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.656956] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.657271] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.657504] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.657749] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "port-2a8565a9-d45d-46d5-bab2-f353a46b6e1c" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.722908] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.723144] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.724551] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.724551] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.772523] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.772628] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.772942] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.772942] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.773166] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.773166] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.773166] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9d153fe4-605f-47fe-a33b-9d019b977fa7 is going to be updated. [ 833.808206] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.808430] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.808430] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.808648] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.808842] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.822758] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9d153fe4-605f-47fe-a33b-9d019b977fa7 in Status: IN_PROGRESS for 2s [ 833.846396] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.846396] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.846396] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.846396] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.846396] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.846396] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 44c5b379-bd5b-44a8-ad31-bc9a9b51d60e is going to be deleted. [ 833.908890] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.909133] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.909239] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.909463] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.909554] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.909676] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-44c5b379-bd5b-44a8-ad31-bc9a9b51d60e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.909827] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-44c5b379-bd5b-44a8-ad31-bc9a9b51d60e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.912306] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-44c5b379-bd5b-44a8-ad31-bc9a9b51d60e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.912306] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('44c5b379-bd5b-44a8-ad31-bc9a9b51d60e',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.926022] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 24a7b083-b432-46d6-94de-76adf6ce22b3: rpc.has_security_group_logging(os_id): False [ 833.946141] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.946369] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.946369] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.946612] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.946682] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.946891] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.946995] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.947071] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.947239] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.947321] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.950210] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.950276] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.950493] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.950493] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.950679] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.950760] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.950856] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.950918] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.951175] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.951274] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.951371] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 24a7b083-b432-46d6-94de-76adf6ce22b3 is going to be updated. [ 834.010765] env[69188]: INFO networking_nsxv3.common.synchronization [req-ced3a2dc-1b99-4bdf-9735-3fa67d509094 req-779a7c32-4c08-4100-863d-7fcd89519b12 tempest-ServerAddressesTestJSON-2052626003 tempest-ServerAddressesTestJSON-2052626003-project-member] Enqueued Resource ID: 948c6e1f-1c67-4d7c-bf02-0ca6a7c3cbda with Priority: HIGHEST for action security_group_members [ 834.011543] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 948c6e1f-1c67-4d7c-bf02-0ca6a7c3cbda with Priority: HIGHEST for action security_group_members [ 834.011879] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-948c6e1f-1c67-4d7c-bf02-0ca6a7c3cbda taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.014326] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-948c6e1f-1c67-4d7c-bf02-0ca6a7c3cbda" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.014326] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-948c6e1f-1c67-4d7c-bf02-0ca6a7c3cbda" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.014326] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-948c6e1f-1c67-4d7c-bf02-0ca6a7c3cbda" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.014326] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.014326] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.014326] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.014326] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.014326] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.014326] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('948c6e1f-1c67-4d7c-bf02-0ca6a7c3cbda',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.030501] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.030501] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.030501] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.030501] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.030501] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.049298] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.049489] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.049595] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.049892] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.050059] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.050259] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 345a1564-5c47-4d81-9096-66a6ad96570a is going to be updated. [ 834.056394] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 24a7b083-b432-46d6-94de-76adf6ce22b3 in Status: IN_PROGRESS for 2s [ 834.081012] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.081233] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.081233] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.081481] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.081625] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.090448] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 345a1564-5c47-4d81-9096-66a6ad96570a in Status: IN_PROGRESS for 2s [ 834.191661] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 199db626-eef5-4a20-b92a-585841c1cff4 in Status: SUCCESS [ 834.191844] env[69188]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 199db626-eef5-4a20-b92a-585841c1cff4 deletion is rescheduled due to dependency. [ 834.194017] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-199db626-eef5-4a20-b92a-585841c1cff4" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.435514] env[69188]: INFO networking_nsxv3.common.synchronization [req-45f9dc02-d407-4b49-8a7f-c44518e3efef req-158d0746-4449-4196-b609-5de3cd21e909 service nova] Enqueued Resource ID: 345a1564-5c47-4d81-9096-66a6ad96570a with Priority: HIGHEST for action security_group_rules [ 834.437601] env[69188]: INFO networking_nsxv3.common.synchronization [req-45f9dc02-d407-4b49-8a7f-c44518e3efef req-158d0746-4449-4196-b609-5de3cd21e909 service nova] Enqueued Resource ID: 345a1564-5c47-4d81-9096-66a6ad96570a with Priority: HIGHEST for action security_group_members [ 834.437601] env[69188]: INFO networking_nsxv3.common.synchronization [req-45f9dc02-d407-4b49-8a7f-c44518e3efef req-158d0746-4449-4196-b609-5de3cd21e909 service nova] Enqueued Resource ID: 2a8565a9-d45d-46d5-bab2-f353a46b6e1c with Priority: HIGHEST for action port [ 834.439612] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.439713] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.439759] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.440016] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.440147] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.440260] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 44c5b379-bd5b-44a8-ad31-bc9a9b51d60e already deleted. [ 834.440399] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-44c5b379-bd5b-44a8-ad31-bc9a9b51d60e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.440602] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 345a1564-5c47-4d81-9096-66a6ad96570a with Priority: HIGHEST for action security_group_rules [ 834.444281] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 345a1564-5c47-4d81-9096-66a6ad96570a with Priority: HIGHEST for action security_group_members [ 834.444281] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2a8565a9-d45d-46d5-bab2-f353a46b6e1c with Priority: HIGHEST for action port [ 834.444281] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-345a1564-5c47-4d81-9096-66a6ad96570a taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.444281] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-345a1564-5c47-4d81-9096-66a6ad96570a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.444281] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-345a1564-5c47-4d81-9096-66a6ad96570a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.444281] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-345a1564-5c47-4d81-9096-66a6ad96570a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.444281] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('345a1564-5c47-4d81-9096-66a6ad96570a',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.444281] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-345a1564-5c47-4d81-9096-66a6ad96570a taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.444281] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-345a1564-5c47-4d81-9096-66a6ad96570a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.444281] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-2a8565a9-d45d-46d5-bab2-f353a46b6e1c taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.444281] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2a8565a9-d45d-46d5-bab2-f353a46b6e1c" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.444281] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2a8565a9-d45d-46d5-bab2-f353a46b6e1c" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.444281] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2a8565a9-d45d-46d5-bab2-f353a46b6e1c" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.444281] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2a8565a9-d45d-46d5-bab2-f353a46b6e1c',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.517798] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.517798] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.517798] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.517798] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.517798] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.517798] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.517798] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.517798] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.517798] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.517798] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.517798] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 948c6e1f-1c67-4d7c-bf02-0ca6a7c3cbda is going to be updated. [ 834.543539] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.546609] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.546609] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.546609] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.546609] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.552906] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 948c6e1f-1c67-4d7c-bf02-0ca6a7c3cbda in Status: IN_PROGRESS for 2s [ 834.947959] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2a8565a9-d45d-46d5-bab2-f353a46b6e1c with status ACTIVE [ 834.948274] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.948490] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.948490] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.948648] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.948725] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.948925] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.949045] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.949111] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.949263] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.949342] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.949526] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.949620] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.949682] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.949827] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.949960] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.950025] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2a8565a9-d45d-46d5-bab2-f353a46b6e1c is going to be updated. [ 834.952244] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-345a1564-5c47-4d81-9096-66a6ad96570a taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.952343] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-345a1564-5c47-4d81-9096-66a6ad96570a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.973176] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.973360] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.973433] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.973656] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.973878] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.974060] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2a8565a9-d45d-46d5-bab2-f353a46b6e1c" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.306780] env[69188]: INFO networking_nsxv3.common.synchronization [req-99074787-ae12-429c-89f1-164743d9c788 req-06101abf-8e81-497c-a06d-de375baaae3c tempest-ServersWithSpecificFlavorTestJSON-1359499520 tempest-ServersWithSpecificFlavorTestJSON-1359499520-project-member] Enqueued Resource ID: ec45d27b-caa2-4488-8317-d6595de404b8 with Priority: HIGHEST for action security_group_members [ 835.306780] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ec45d27b-caa2-4488-8317-d6595de404b8 with Priority: HIGHEST for action security_group_members [ 835.306780] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-ec45d27b-caa2-4488-8317-d6595de404b8 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.306780] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ec45d27b-caa2-4488-8317-d6595de404b8" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.306780] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ec45d27b-caa2-4488-8317-d6595de404b8" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.306780] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ec45d27b-caa2-4488-8317-d6595de404b8" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.307216] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.307487] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.307674] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.308034] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.308304] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.308566] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ec45d27b-caa2-4488-8317-d6595de404b8',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.638719] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 867581e0-cbbd-4108-a823-0b7c53d47c3a in Status: SUCCESS [ 835.638967] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-867581e0-cbbd-4108-a823-0b7c53d47c3a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.639128] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-867581e0-cbbd-4108-a823-0b7c53d47c3a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.639341] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-867581e0-cbbd-4108-a823-0b7c53d47c3a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.639575] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.639671] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.639709] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.639851] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.639936] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.640039] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-867581e0-cbbd-4108-a823-0b7c53d47c3a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.640145] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('867581e0-cbbd-4108-a823-0b7c53d47c3a',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.673796] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock network-603 taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.674029] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "network-603" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.674167] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "network-603" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.674483] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "network-603" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.674773] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.674952] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.678278] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.678563] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.678689] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.679044] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 835.679197] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] NeedRegenerationException {{(pid=69188) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 835.679361] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] no value, waiting for create lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 835.679461] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] value creation lock acquired {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 835.679578] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 835.679769] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Calling creation function for not-yet-present value {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 835.679878] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 835.699706] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 835.699896] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69188) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 835.700055] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Released creation lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 835.700276] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "network-603" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.700624] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock port-b5a47767-92b4-4fec-beda-7f35e826d129 taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.701134] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "port-b5a47767-92b4-4fec-beda-7f35e826d129" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.701134] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "port-b5a47767-92b4-4fec-beda-7f35e826d129" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.701754] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "port-b5a47767-92b4-4fec-beda-7f35e826d129" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.701754] env[69188]: DEBUG networking_nsxv3.api.rpc [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b5a47767-92b4-4fec-beda-7f35e826d129',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.811334] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.811488] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.811569] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.811782] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.811884] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.812094] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.812195] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.812256] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.812407] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.812484] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.812571] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ec45d27b-caa2-4488-8317-d6595de404b8 is going to be deleted. [ 835.831619] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9d153fe4-605f-47fe-a33b-9d019b977fa7 in Status: SUCCESS [ 835.831619] env[69188]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9d153fe4-605f-47fe-a33b-9d019b977fa7 deletion is rescheduled due to dependency. [ 835.831619] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9d153fe4-605f-47fe-a33b-9d019b977fa7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.843023] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.843023] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.843023] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.843023] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.843023] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.843348] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ec45d27b-caa2-4488-8317-d6595de404b8" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.069082] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 24a7b083-b432-46d6-94de-76adf6ce22b3 in Status: SUCCESS [ 836.069425] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-24a7b083-b432-46d6-94de-76adf6ce22b3" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.100432] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 345a1564-5c47-4d81-9096-66a6ad96570a in Status: SUCCESS [ 836.100572] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-345a1564-5c47-4d81-9096-66a6ad96570a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.100707] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-345a1564-5c47-4d81-9096-66a6ad96570a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.100926] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-345a1564-5c47-4d81-9096-66a6ad96570a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.101132] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.101242] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.101306] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.101848] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.101848] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.101848] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('345a1564-5c47-4d81-9096-66a6ad96570a',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.142582] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('867581e0-cbbd-4108-a823-0b7c53d47c3a',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.204903] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.204903] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.205095] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.205496] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.206011] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.206011] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Segment Port b5a47767-92b4-4fec-beda-7f35e826d129 not found, creating... [ 836.206340] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.206554] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.206662] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.206928] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.207093] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.207456] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.207608] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.207740] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.208033] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.208194] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.208362] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Resource: SegmentPort with ID: b5a47767-92b4-4fec-beda-7f35e826d129 is going to be created. [ 836.227886] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.228493] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.228654] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.228943] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.229188] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.229432] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "port-b5a47767-92b4-4fec-beda-7f35e826d129" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.566824] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 948c6e1f-1c67-4d7c-bf02-0ca6a7c3cbda in Status: SUCCESS [ 836.567136] env[69188]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 948c6e1f-1c67-4d7c-bf02-0ca6a7c3cbda deletion is rescheduled due to dependency. [ 836.567334] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-948c6e1f-1c67-4d7c-bf02-0ca6a7c3cbda" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.604602] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('345a1564-5c47-4d81-9096-66a6ad96570a',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.645703] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 867581e0-cbbd-4108-a823-0b7c53d47c3a: rpc.has_security_group_logging(os_id): False [ 836.661731] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.661872] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.661940] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.662214] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.662317] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.662616] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.662964] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.663089] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.663594] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.663594] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.663818] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 867581e0-cbbd-4108-a823-0b7c53d47c3a is going to be created. [ 836.744829] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.744829] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.744829] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.744829] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.744829] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.753697] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 867581e0-cbbd-4108-a823-0b7c53d47c3a in Status: IN_PROGRESS for 2s [ 837.107424] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('345a1564-5c47-4d81-9096-66a6ad96570a',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.532778] env[69188]: INFO networking_nsxv3.common.synchronization [req-99074787-ae12-429c-89f1-164743d9c788 req-667e83a8-d93c-4afd-a4a2-919bb2f7492b service nova] Enqueued Resource ID: ec45d27b-caa2-4488-8317-d6595de404b8 with Priority: HIGHEST for action security_group_rules [ 837.532967] env[69188]: INFO networking_nsxv3.common.synchronization [req-99074787-ae12-429c-89f1-164743d9c788 req-667e83a8-d93c-4afd-a4a2-919bb2f7492b service nova] Enqueued Resource ID: ec45d27b-caa2-4488-8317-d6595de404b8 with Priority: HIGHEST for action security_group_members [ 837.533131] env[69188]: INFO networking_nsxv3.common.synchronization [req-99074787-ae12-429c-89f1-164743d9c788 req-667e83a8-d93c-4afd-a4a2-919bb2f7492b service nova] Enqueued Resource ID: b5a47767-92b4-4fec-beda-7f35e826d129 with Priority: HIGHEST for action port [ 837.533363] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ec45d27b-caa2-4488-8317-d6595de404b8 with Priority: HIGHEST for action security_group_rules [ 837.533489] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ec45d27b-caa2-4488-8317-d6595de404b8 with Priority: HIGHEST for action security_group_members [ 837.533598] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b5a47767-92b4-4fec-beda-7f35e826d129 with Priority: HIGHEST for action port [ 837.537092] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ec45d27b-caa2-4488-8317-d6595de404b8 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.537092] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ec45d27b-caa2-4488-8317-d6595de404b8" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.537519] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ec45d27b-caa2-4488-8317-d6595de404b8" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.537519] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ec45d27b-caa2-4488-8317-d6595de404b8" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.537584] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ec45d27b-caa2-4488-8317-d6595de404b8',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.539142] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-ec45d27b-caa2-4488-8317-d6595de404b8 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.539294] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ec45d27b-caa2-4488-8317-d6595de404b8" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.539362] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ec45d27b-caa2-4488-8317-d6595de404b8" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.539542] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ec45d27b-caa2-4488-8317-d6595de404b8" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.542762] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.542762] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.542762] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.542762] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.542762] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.542762] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ec45d27b-caa2-4488-8317-d6595de404b8',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.543721] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-b5a47767-92b4-4fec-beda-7f35e826d129 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.543721] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b5a47767-92b4-4fec-beda-7f35e826d129" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.543880] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b5a47767-92b4-4fec-beda-7f35e826d129" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.543938] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b5a47767-92b4-4fec-beda-7f35e826d129" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.544013] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b5a47767-92b4-4fec-beda-7f35e826d129',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.611861] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.611861] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.611861] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.612054] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.612054] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.612116] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 345a1564-5c47-4d81-9096-66a6ad96570a is going to be updated. [ 837.638910] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.639098] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.639170] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.639378] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.639521] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.647809] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 345a1564-5c47-4d81-9096-66a6ad96570a in Status: IN_PROGRESS for 2s [ 838.047515] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-ec45d27b-caa2-4488-8317-d6595de404b8 taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.047515] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ec45d27b-caa2-4488-8317-d6595de404b8" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.050854] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b5a47767-92b4-4fec-beda-7f35e826d129 with status ACTIVE [ 838.052268] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.052462] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.052503] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.053048] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.053048] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.053048] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.053234] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.053234] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.053332] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.053412] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.053612] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.053711] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.053772] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.053914] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.053990] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.054105] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b5a47767-92b4-4fec-beda-7f35e826d129 is going to be updated. [ 838.055791] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ec45d27b-caa2-4488-8317-d6595de404b8',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.075434] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.075620] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.075745] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.075897] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.076046] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.076212] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b5a47767-92b4-4fec-beda-7f35e826d129" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.336557] env[69188]: INFO networking_nsxv3.common.synchronization [req-b3a1ffb2-d837-44c6-a679-7623cbbc2ac5 req-c9b8b078-a029-40b6-8905-a56822341190 tempest-ListImageFiltersTestJSON-1208479351 tempest-ListImageFiltersTestJSON-1208479351-project-member] Enqueued Resource ID: e6233127-d754-46c4-9840-1e77714a63d1 with Priority: HIGHEST for action security_group_members [ 838.338160] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e6233127-d754-46c4-9840-1e77714a63d1 with Priority: HIGHEST for action security_group_members [ 838.338160] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-e6233127-d754-46c4-9840-1e77714a63d1 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.338160] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e6233127-d754-46c4-9840-1e77714a63d1" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.338160] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e6233127-d754-46c4-9840-1e77714a63d1" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.338160] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e6233127-d754-46c4-9840-1e77714a63d1" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.338160] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.338160] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.338522] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.338522] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.338522] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.338522] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e6233127-d754-46c4-9840-1e77714a63d1',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.562869] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ec45d27b-caa2-4488-8317-d6595de404b8',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.766322] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock network-267 taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.766567] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "network-267" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.766714] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "network-267" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.767893] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "network-267" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.768211] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.768382] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.768506] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.768808] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.768911] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.769170] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 838.769395] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] NeedRegenerationException {{(pid=69188) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 838.769395] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] no value, waiting for create lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 838.769495] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] value creation lock acquired {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 838.769613] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 838.769712] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Calling creation function for not-yet-present value {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 838.769849] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 838.771443] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 867581e0-cbbd-4108-a823-0b7c53d47c3a in Status: SUCCESS [ 838.771640] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-867581e0-cbbd-4108-a823-0b7c53d47c3a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.802639] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 838.802890] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Cache value generated in 0.033 seconds for key(s): 'zone-id' {{(pid=69188) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 838.803090] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Released creation lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 838.803336] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "network-267" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.803769] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock port-63a8f7e4-aeb9-45a6-a16d-1dd27836f548 taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.803973] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "port-63a8f7e4-aeb9-45a6-a16d-1dd27836f548" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.804113] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "port-63a8f7e4-aeb9-45a6-a16d-1dd27836f548" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.804452] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "port-63a8f7e4-aeb9-45a6-a16d-1dd27836f548" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.804659] env[69188]: DEBUG networking_nsxv3.api.rpc [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('63a8f7e4-aeb9-45a6-a16d-1dd27836f548',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.840330] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.840474] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.840544] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.841671] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.841671] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.841671] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.841887] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.841887] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.842025] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.842094] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.842173] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e6233127-d754-46c4-9840-1e77714a63d1 already deleted. [ 838.842268] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e6233127-d754-46c4-9840-1e77714a63d1" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.957229] env[69188]: INFO networking_nsxv3.common.synchronization [None req-d2944cdc-cd02-4c83-88bc-51b91d8a406d None None] Enqueued Resource ID: 34d5af94-9886-4571-94e9-53a298450881 with Priority: HIGHEST for action port [ 838.957730] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 34d5af94-9886-4571-94e9-53a298450881 with Priority: HIGHEST for action port [ 838.958084] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-34d5af94-9886-4571-94e9-53a298450881 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.958779] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-34d5af94-9886-4571-94e9-53a298450881" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.958779] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-34d5af94-9886-4571-94e9-53a298450881" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.958779] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-34d5af94-9886-4571-94e9-53a298450881" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.958779] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('34d5af94-9886-4571-94e9-53a298450881',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.064484] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.064683] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.064836] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.064989] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.065218] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.065307] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ec45d27b-caa2-4488-8317-d6595de404b8 is going to be created. [ 839.089465] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.089637] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.089701] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.089887] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.090074] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.100187] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ec45d27b-caa2-4488-8317-d6595de404b8 in Status: UNINITIALIZED for 2s [ 839.312026] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.312026] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.312026] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.312026] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.312026] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.312026] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Segment Port 63a8f7e4-aeb9-45a6-a16d-1dd27836f548 not found, creating... [ 839.312026] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.312026] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.312026] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.312026] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.312026] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.313252] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.313720] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.317340] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.317340] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.317340] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.317340] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Resource: SegmentPort with ID: 63a8f7e4-aeb9-45a6-a16d-1dd27836f548 is going to be created. [ 839.364345] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.364345] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.364345] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.364345] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.364345] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.364345] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "port-63a8f7e4-aeb9-45a6-a16d-1dd27836f548" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.461012] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 34d5af94-9886-4571-94e9-53a298450881 [ 839.461305] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.461459] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.461539] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.462570] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.462570] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.462570] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:34d5af94-9886-4571-94e9-53a298450881 already deleted. [ 839.462570] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-34d5af94-9886-4571-94e9-53a298450881" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.657520] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 345a1564-5c47-4d81-9096-66a6ad96570a in Status: IN_PROGRESS for 4s [ 840.177179] env[69188]: INFO networking_nsxv3.common.synchronization [None req-f73e798a-ec7e-4732-93ca-83be7cc1ba87 tempest-AttachInterfacesUnderV243Test-1529073749 tempest-AttachInterfacesUnderV243Test-1529073749-project-member] Enqueued Resource ID: e4039e1d-9712-484a-9e32-16f2dc6c2311 with Priority: HIGHEST for action security_group_rules [ 840.177763] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e4039e1d-9712-484a-9e32-16f2dc6c2311 with Priority: HIGHEST for action security_group_rules [ 840.179520] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e4039e1d-9712-484a-9e32-16f2dc6c2311 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.179624] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e4039e1d-9712-484a-9e32-16f2dc6c2311" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.179719] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e4039e1d-9712-484a-9e32-16f2dc6c2311" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.180140] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e4039e1d-9712-484a-9e32-16f2dc6c2311" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.180140] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e4039e1d-9712-484a-9e32-16f2dc6c2311',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.224148] env[69188]: INFO networking_nsxv3.common.synchronization [req-b3a1ffb2-d837-44c6-a679-7623cbbc2ac5 req-93d819ed-8c74-4a30-af7d-4afb19111d44 service nova] Enqueued Resource ID: e6233127-d754-46c4-9840-1e77714a63d1 with Priority: HIGHEST for action security_group_rules [ 840.225177] env[69188]: INFO networking_nsxv3.common.synchronization [req-b3a1ffb2-d837-44c6-a679-7623cbbc2ac5 req-93d819ed-8c74-4a30-af7d-4afb19111d44 service nova] Enqueued Resource ID: e6233127-d754-46c4-9840-1e77714a63d1 with Priority: HIGHEST for action security_group_members [ 840.225177] env[69188]: INFO networking_nsxv3.common.synchronization [req-b3a1ffb2-d837-44c6-a679-7623cbbc2ac5 req-93d819ed-8c74-4a30-af7d-4afb19111d44 service nova] Enqueued Resource ID: 63a8f7e4-aeb9-45a6-a16d-1dd27836f548 with Priority: HIGHEST for action port [ 840.225529] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e6233127-d754-46c4-9840-1e77714a63d1 with Priority: HIGHEST for action security_group_rules [ 840.225888] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e6233127-d754-46c4-9840-1e77714a63d1 with Priority: HIGHEST for action security_group_members [ 840.225888] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 63a8f7e4-aeb9-45a6-a16d-1dd27836f548 with Priority: HIGHEST for action port [ 840.226430] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e6233127-d754-46c4-9840-1e77714a63d1 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.232279] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e6233127-d754-46c4-9840-1e77714a63d1" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.232279] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e6233127-d754-46c4-9840-1e77714a63d1" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.232279] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e6233127-d754-46c4-9840-1e77714a63d1" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.232279] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e6233127-d754-46c4-9840-1e77714a63d1',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.232279] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-e6233127-d754-46c4-9840-1e77714a63d1 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.232279] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e6233127-d754-46c4-9840-1e77714a63d1" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.232279] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e6233127-d754-46c4-9840-1e77714a63d1" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.232279] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e6233127-d754-46c4-9840-1e77714a63d1" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.232279] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.232279] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.232279] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.232279] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.232279] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.232279] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e6233127-d754-46c4-9840-1e77714a63d1',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.232279] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-63a8f7e4-aeb9-45a6-a16d-1dd27836f548 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.234902] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-63a8f7e4-aeb9-45a6-a16d-1dd27836f548" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.236072] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-63a8f7e4-aeb9-45a6-a16d-1dd27836f548" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.236072] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-63a8f7e4-aeb9-45a6-a16d-1dd27836f548" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.236072] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('63a8f7e4-aeb9-45a6-a16d-1dd27836f548',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.365883] env[69188]: INFO networking_nsxv3.common.synchronization [None req-ca766a9f-51cf-4481-a0f8-4fdd3d061b31 tempest-AttachInterfacesUnderV243Test-1529073749 tempest-AttachInterfacesUnderV243Test-1529073749-project-member] Enqueued Resource ID: e4039e1d-9712-484a-9e32-16f2dc6c2311 with Priority: HIGHEST for action security_group_rules [ 840.367937] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e4039e1d-9712-484a-9e32-16f2dc6c2311 with Priority: HIGHEST for action security_group_rules [ 840.367937] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e4039e1d-9712-484a-9e32-16f2dc6c2311 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.367937] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e4039e1d-9712-484a-9e32-16f2dc6c2311" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.703274] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.703522] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.703522] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.703841] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.703841] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.704036] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e4039e1d-9712-484a-9e32-16f2dc6c2311 already deleted. [ 840.704036] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e4039e1d-9712-484a-9e32-16f2dc6c2311" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.704786] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e4039e1d-9712-484a-9e32-16f2dc6c2311" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.704786] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e4039e1d-9712-484a-9e32-16f2dc6c2311" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.704786] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e4039e1d-9712-484a-9e32-16f2dc6c2311',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.738341] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-e6233127-d754-46c4-9840-1e77714a63d1 taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.738576] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e6233127-d754-46c4-9840-1e77714a63d1" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.739031] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e6233127-d754-46c4-9840-1e77714a63d1',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.744030] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 63a8f7e4-aeb9-45a6-a16d-1dd27836f548 with status ACTIVE [ 840.744030] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.744030] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.744030] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.744030] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.744030] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.744030] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.744030] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.744030] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.744030] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.744030] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.744030] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.744030] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.744030] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.744030] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.744030] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.744030] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 63a8f7e4-aeb9-45a6-a16d-1dd27836f548 is going to be updated. [ 840.761680] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.761826] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.761882] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.762057] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.762547] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.762547] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-63a8f7e4-aeb9-45a6-a16d-1dd27836f548" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.050187] env[69188]: INFO networking_nsxv3.common.synchronization [None req-f1e9bb0e-ff50-4a25-814c-d3f7ff2a9cfd None None] Enqueued Resource ID: 58437ccd-5071-4a3e-a710-d2290b24a7f6 with Priority: HIGHEST for action port [ 841.050187] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 58437ccd-5071-4a3e-a710-d2290b24a7f6 with Priority: HIGHEST for action port [ 841.051652] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-58437ccd-5071-4a3e-a710-d2290b24a7f6 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.052074] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-58437ccd-5071-4a3e-a710-d2290b24a7f6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.052234] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-58437ccd-5071-4a3e-a710-d2290b24a7f6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.052709] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-58437ccd-5071-4a3e-a710-d2290b24a7f6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.052889] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('58437ccd-5071-4a3e-a710-d2290b24a7f6',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.114474] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ec45d27b-caa2-4488-8317-d6595de404b8 in Status: SUCCESS [ 841.114474] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ec45d27b-caa2-4488-8317-d6595de404b8" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.114474] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ec45d27b-caa2-4488-8317-d6595de404b8" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.114474] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ec45d27b-caa2-4488-8317-d6595de404b8" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.114474] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.114474] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.114474] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.114474] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.114474] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.114474] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ec45d27b-caa2-4488-8317-d6595de404b8" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.114474] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ec45d27b-caa2-4488-8317-d6595de404b8',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.228475] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.228475] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.228475] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.228475] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.228475] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.228475] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e4039e1d-9712-484a-9e32-16f2dc6c2311 already deleted. [ 841.228475] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e4039e1d-9712-484a-9e32-16f2dc6c2311" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.250169] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e6233127-d754-46c4-9840-1e77714a63d1',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.557103] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 58437ccd-5071-4a3e-a710-d2290b24a7f6 [ 841.557103] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.557103] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.557103] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.557103] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.557103] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.557103] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:58437ccd-5071-4a3e-a710-d2290b24a7f6 already deleted. [ 841.557103] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-58437ccd-5071-4a3e-a710-d2290b24a7f6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.618435] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ec45d27b-caa2-4488-8317-d6595de404b8',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.668487] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 345a1564-5c47-4d81-9096-66a6ad96570a in Status: SUCCESS [ 841.668726] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-345a1564-5c47-4d81-9096-66a6ad96570a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.669288] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-345a1564-5c47-4d81-9096-66a6ad96570a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.669510] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-345a1564-5c47-4d81-9096-66a6ad96570a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.670032] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.670122] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.670122] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.670318] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.670407] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.670496] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-345a1564-5c47-4d81-9096-66a6ad96570a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.670675] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('345a1564-5c47-4d81-9096-66a6ad96570a',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.750633] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.750827] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.750827] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.751038] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.751135] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.751234] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e6233127-d754-46c4-9840-1e77714a63d1 is going to be created. [ 841.773838] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.774049] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.774905] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.775246] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.775421] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.791699] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e6233127-d754-46c4-9840-1e77714a63d1 in Status: UNINITIALIZED for 2s [ 842.120567] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ec45d27b-caa2-4488-8317-d6595de404b8: rpc.has_security_group_logging(os_id): False [ 842.143049] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.143202] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.143372] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.143629] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.143746] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.144083] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.144204] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.144254] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.144408] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.144483] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.144568] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ec45d27b-caa2-4488-8317-d6595de404b8 is going to be created. [ 842.173287] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-345a1564-5c47-4d81-9096-66a6ad96570a taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.173471] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-345a1564-5c47-4d81-9096-66a6ad96570a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.173556] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-345a1564-5c47-4d81-9096-66a6ad96570a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.173827] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-345a1564-5c47-4d81-9096-66a6ad96570a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.174015] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.174097] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.174097] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.174276] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.174364] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.174450] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-345a1564-5c47-4d81-9096-66a6ad96570a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.174622] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-345a1564-5c47-4d81-9096-66a6ad96570a taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.174709] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-345a1564-5c47-4d81-9096-66a6ad96570a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.174767] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-345a1564-5c47-4d81-9096-66a6ad96570a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.174910] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-345a1564-5c47-4d81-9096-66a6ad96570a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.175074] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.175156] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.175209] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.175340] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.175411] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.175481] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-345a1564-5c47-4d81-9096-66a6ad96570a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.175568] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('345a1564-5c47-4d81-9096-66a6ad96570a',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.229930] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.230107] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.230185] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.230395] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.230574] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.253246] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ec45d27b-caa2-4488-8317-d6595de404b8 in Status: IN_PROGRESS for 2s [ 842.681480] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 345a1564-5c47-4d81-9096-66a6ad96570a: rpc.has_security_group_logging(os_id): False [ 842.701025] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.701025] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.701025] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.701025] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.701025] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.701025] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.701025] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.701025] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.701025] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.701025] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.701025] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.701025] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.701025] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.701025] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.702486] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.702486] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.702486] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.702486] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.702486] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.702486] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.702486] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 345a1564-5c47-4d81-9096-66a6ad96570a is going to be updated. [ 842.802628] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.802764] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.802874] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.803170] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.803358] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.810664] env[69188]: INFO networking_nsxv3.common.synchronization [req-6437f7c6-07eb-4253-9563-f9eeb63f9e7b req-bef3e962-bd24-45ab-a01a-49f82315ba8e tempest-ListImageFiltersTestJSON-1208479351 tempest-ListImageFiltersTestJSON-1208479351-project-member] Enqueued Resource ID: e6233127-d754-46c4-9840-1e77714a63d1 with Priority: HIGHEST for action security_group_members [ 842.810954] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e6233127-d754-46c4-9840-1e77714a63d1 with Priority: HIGHEST for action security_group_members [ 842.811476] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-e6233127-d754-46c4-9840-1e77714a63d1 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.811969] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e6233127-d754-46c4-9840-1e77714a63d1" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.818297] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 345a1564-5c47-4d81-9096-66a6ad96570a in Status: IN_PROGRESS for 2s [ 843.178114] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock network-267 taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.178321] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "network-267" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.178454] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "network-267" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.178738] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "network-267" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.179030] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.179187] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.179309] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.180269] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.181900] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.181900] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 843.181900] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] NeedRegenerationException {{(pid=69188) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 843.181900] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] no value, waiting for create lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 843.181900] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] value creation lock acquired {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 843.181900] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 843.181900] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Calling creation function for not-yet-present value {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 843.181900] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 843.204864] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 843.204864] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=69188) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 843.204864] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Released creation lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 843.204864] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "network-267" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.205110] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock port-3dd1c581-8752-4aab-8884-579a03220f4d taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.205191] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "port-3dd1c581-8752-4aab-8884-579a03220f4d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.206364] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "port-3dd1c581-8752-4aab-8884-579a03220f4d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.206364] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "port-3dd1c581-8752-4aab-8884-579a03220f4d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.206364] env[69188]: DEBUG networking_nsxv3.api.rpc [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3dd1c581-8752-4aab-8884-579a03220f4d',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.710058] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.710383] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.710647] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.710712] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.710871] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.711048] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Segment Port 3dd1c581-8752-4aab-8884-579a03220f4d not found, creating... [ 843.711323] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.711486] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.711603] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.711863] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.712526] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.712526] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.712526] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.712735] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.712981] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.712981] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.713157] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Resource: SegmentPort with ID: 3dd1c581-8752-4aab-8884-579a03220f4d is going to be created. [ 843.747786] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.748060] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.748200] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.748477] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.748706] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.748973] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "port-3dd1c581-8752-4aab-8884-579a03220f4d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.811949] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e6233127-d754-46c4-9840-1e77714a63d1 in Status: SUCCESS [ 843.812194] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e6233127-d754-46c4-9840-1e77714a63d1" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.812361] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e6233127-d754-46c4-9840-1e77714a63d1" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.812564] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e6233127-d754-46c4-9840-1e77714a63d1" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.812758] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.812875] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.812936] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.813190] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.813273] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.813307] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e6233127-d754-46c4-9840-1e77714a63d1" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.813374] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e6233127-d754-46c4-9840-1e77714a63d1',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.815993] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e6233127-d754-46c4-9840-1e77714a63d1" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.816192] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e6233127-d754-46c4-9840-1e77714a63d1" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.816482] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.816482] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.816571] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.816646] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.816702] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.816784] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e6233127-d754-46c4-9840-1e77714a63d1',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.269123] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ec45d27b-caa2-4488-8317-d6595de404b8 in Status: SUCCESS [ 844.269414] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ec45d27b-caa2-4488-8317-d6595de404b8" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.317278] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-e6233127-d754-46c4-9840-1e77714a63d1 taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.317480] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e6233127-d754-46c4-9840-1e77714a63d1" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.318748] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e6233127-d754-46c4-9840-1e77714a63d1',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.622148] env[69188]: INFO networking_nsxv3.common.synchronization [req-6437f7c6-07eb-4253-9563-f9eeb63f9e7b req-5ba860f5-a184-4a28-8e5c-4c9a924cd4be service nova] Enqueued Resource ID: e6233127-d754-46c4-9840-1e77714a63d1 with Priority: HIGHEST for action security_group_rules [ 844.622336] env[69188]: INFO networking_nsxv3.common.synchronization [req-6437f7c6-07eb-4253-9563-f9eeb63f9e7b req-5ba860f5-a184-4a28-8e5c-4c9a924cd4be service nova] Enqueued Resource ID: e6233127-d754-46c4-9840-1e77714a63d1 with Priority: HIGHEST for action security_group_members [ 844.622479] env[69188]: INFO networking_nsxv3.common.synchronization [req-6437f7c6-07eb-4253-9563-f9eeb63f9e7b req-5ba860f5-a184-4a28-8e5c-4c9a924cd4be service nova] Enqueued Resource ID: 3dd1c581-8752-4aab-8884-579a03220f4d with Priority: HIGHEST for action port [ 844.622712] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e6233127-d754-46c4-9840-1e77714a63d1 with Priority: HIGHEST for action security_group_rules [ 844.622888] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e6233127-d754-46c4-9840-1e77714a63d1 with Priority: HIGHEST for action security_group_members [ 844.622924] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3dd1c581-8752-4aab-8884-579a03220f4d with Priority: HIGHEST for action port [ 844.623483] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e6233127-d754-46c4-9840-1e77714a63d1 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.623619] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e6233127-d754-46c4-9840-1e77714a63d1" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.623827] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-e6233127-d754-46c4-9840-1e77714a63d1 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.623876] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e6233127-d754-46c4-9840-1e77714a63d1" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.627296] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-3dd1c581-8752-4aab-8884-579a03220f4d taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.627485] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3dd1c581-8752-4aab-8884-579a03220f4d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.627552] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3dd1c581-8752-4aab-8884-579a03220f4d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.627767] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3dd1c581-8752-4aab-8884-579a03220f4d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.627845] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3dd1c581-8752-4aab-8884-579a03220f4d',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.820662] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e6233127-d754-46c4-9840-1e77714a63d1',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.833764] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 345a1564-5c47-4d81-9096-66a6ad96570a in Status: SUCCESS [ 844.834010] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-345a1564-5c47-4d81-9096-66a6ad96570a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.132401] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3dd1c581-8752-4aab-8884-579a03220f4d with status ACTIVE [ 845.132647] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.132788] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.132860] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.133100] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.133194] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.133495] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.133495] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.133620] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.133679] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.133755] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.133932] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.134050] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.134127] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.134274] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.134349] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.134466] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3dd1c581-8752-4aab-8884-579a03220f4d is going to be updated. [ 845.155809] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.155979] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.156065] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.157071] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.157071] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.157071] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3dd1c581-8752-4aab-8884-579a03220f4d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.325710] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.325710] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.325710] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.325710] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.325710] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.325710] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e6233127-d754-46c4-9840-1e77714a63d1 is going to be updated. [ 845.353487] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.353487] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.353487] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.353487] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.353487] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.360994] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e6233127-d754-46c4-9840-1e77714a63d1 in Status: IN_PROGRESS for 2s [ 847.375460] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e6233127-d754-46c4-9840-1e77714a63d1 in Status: SUCCESS [ 847.376188] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e6233127-d754-46c4-9840-1e77714a63d1" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.376437] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e6233127-d754-46c4-9840-1e77714a63d1" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.376696] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e6233127-d754-46c4-9840-1e77714a63d1" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.376923] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.377091] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.377200] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.377376] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.377481] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.377573] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e6233127-d754-46c4-9840-1e77714a63d1" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.377750] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-e6233127-d754-46c4-9840-1e77714a63d1 taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.377836] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e6233127-d754-46c4-9840-1e77714a63d1" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.377906] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e6233127-d754-46c4-9840-1e77714a63d1" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.378293] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e6233127-d754-46c4-9840-1e77714a63d1" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.378496] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.378692] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.378803] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.378997] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.379134] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.379251] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e6233127-d754-46c4-9840-1e77714a63d1" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.379378] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e6233127-d754-46c4-9840-1e77714a63d1',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.380706] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e6233127-d754-46c4-9840-1e77714a63d1" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.380913] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e6233127-d754-46c4-9840-1e77714a63d1" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.381130] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.382639] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.382771] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.383050] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.383204] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.383370] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e6233127-d754-46c4-9840-1e77714a63d1',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.464558] env[69188]: INFO networking_nsxv3.common.synchronization [req-e26260f9-e81f-4eba-8ed0-dbd97e43dcc6 req-d89404e7-f3d2-4d9e-a227-05bce0b7558e tempest-ServerMetadataTestJSON-1543680343 tempest-ServerMetadataTestJSON-1543680343-project-member] Enqueued Resource ID: 53a4d3c3-01ca-4828-94d1-6fa305c27650 with Priority: HIGHEST for action security_group_members [ 847.464778] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 53a4d3c3-01ca-4828-94d1-6fa305c27650 with Priority: HIGHEST for action security_group_members [ 847.465094] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-53a4d3c3-01ca-4828-94d1-6fa305c27650 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.465215] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-53a4d3c3-01ca-4828-94d1-6fa305c27650" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.465276] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-53a4d3c3-01ca-4828-94d1-6fa305c27650" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.465542] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-53a4d3c3-01ca-4828-94d1-6fa305c27650" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.465708] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.465803] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.465870] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.466019] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.466079] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.466181] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('53a4d3c3-01ca-4828-94d1-6fa305c27650',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.747983] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock network-706 taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.748274] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "network-706" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.748427] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "network-706" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.748774] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "network-706" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.749134] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.749762] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.749762] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.750044] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.750295] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.750846] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 847.751071] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] NeedRegenerationException {{(pid=69188) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 847.751275] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] no value, waiting for create lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 847.751439] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] value creation lock acquired {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 847.751604] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 847.751762] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Calling creation function for not-yet-present value {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 847.751992] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 847.772047] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 847.772047] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69188) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 847.772047] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Released creation lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 847.772047] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "network-706" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.772047] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock port-39a6e13e-097d-4320-88ec-4558a53e8109 taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.772047] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "port-39a6e13e-097d-4320-88ec-4558a53e8109" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.772365] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "port-39a6e13e-097d-4320-88ec-4558a53e8109" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.772557] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "port-39a6e13e-097d-4320-88ec-4558a53e8109" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.772618] env[69188]: DEBUG networking_nsxv3.api.rpc [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('39a6e13e-097d-4320-88ec-4558a53e8109',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.885242] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e6233127-d754-46c4-9840-1e77714a63d1: rpc.has_security_group_logging(os_id): False [ 847.886519] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e6233127-d754-46c4-9840-1e77714a63d1',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.914061] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.914258] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.914331] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.914595] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.914719] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.914963] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.915078] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.915161] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.915361] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.915447] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.915638] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.915724] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.915787] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.915927] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.916008] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.917160] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.917160] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.917160] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.917160] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.917160] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.917160] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e6233127-d754-46c4-9840-1e77714a63d1 is going to be created. [ 847.968679] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.968829] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.968896] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.969137] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.969231] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.969431] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.969530] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.969595] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.969746] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.969822] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.969907] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 53a4d3c3-01ca-4828-94d1-6fa305c27650 already deleted. [ 847.969988] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-53a4d3c3-01ca-4828-94d1-6fa305c27650" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.972795] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.972978] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.973038] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.973237] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.973461] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.984138] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e6233127-d754-46c4-9840-1e77714a63d1 in Status: IN_PROGRESS for 2s [ 848.276532] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.276758] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.276893] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.277311] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.277479] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.277641] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Segment Port 39a6e13e-097d-4320-88ec-4558a53e8109 not found, creating... [ 848.277950] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.278123] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.278245] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.278533] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.278690] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.279051] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.279494] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.279644] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.279860] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.279994] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.280149] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Resource: SegmentPort with ID: 39a6e13e-097d-4320-88ec-4558a53e8109 is going to be created. [ 848.300044] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.300307] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.300492] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.300782] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.301081] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.301345] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "port-39a6e13e-097d-4320-88ec-4558a53e8109" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.392307] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e6233127-d754-46c4-9840-1e77714a63d1',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.894858] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.895087] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.895188] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.895435] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.895587] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.895646] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e6233127-d754-46c4-9840-1e77714a63d1 is going to be updated. [ 848.925076] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.925297] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.925388] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.925675] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.925949] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.935815] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e6233127-d754-46c4-9840-1e77714a63d1 in Status: IN_PROGRESS for 2s [ 849.155862] env[69188]: INFO networking_nsxv3.common.synchronization [req-e26260f9-e81f-4eba-8ed0-dbd97e43dcc6 req-a7364dd7-f806-4ccf-a5ba-0a0788c980fd service nova] Enqueued Resource ID: 53a4d3c3-01ca-4828-94d1-6fa305c27650 with Priority: HIGHEST for action security_group_rules [ 849.157131] env[69188]: INFO networking_nsxv3.common.synchronization [req-e26260f9-e81f-4eba-8ed0-dbd97e43dcc6 req-a7364dd7-f806-4ccf-a5ba-0a0788c980fd service nova] Enqueued Resource ID: 53a4d3c3-01ca-4828-94d1-6fa305c27650 with Priority: HIGHEST for action security_group_members [ 849.161362] env[69188]: INFO networking_nsxv3.common.synchronization [req-e26260f9-e81f-4eba-8ed0-dbd97e43dcc6 req-a7364dd7-f806-4ccf-a5ba-0a0788c980fd service nova] Enqueued Resource ID: 39a6e13e-097d-4320-88ec-4558a53e8109 with Priority: HIGHEST for action port [ 849.161362] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 53a4d3c3-01ca-4828-94d1-6fa305c27650 with Priority: HIGHEST for action security_group_rules [ 849.161362] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 53a4d3c3-01ca-4828-94d1-6fa305c27650 with Priority: HIGHEST for action security_group_members [ 849.161362] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 39a6e13e-097d-4320-88ec-4558a53e8109 with Priority: HIGHEST for action port [ 849.161490] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-53a4d3c3-01ca-4828-94d1-6fa305c27650 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.161598] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-53a4d3c3-01ca-4828-94d1-6fa305c27650" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.161663] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-53a4d3c3-01ca-4828-94d1-6fa305c27650" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.161914] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-53a4d3c3-01ca-4828-94d1-6fa305c27650" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.161991] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('53a4d3c3-01ca-4828-94d1-6fa305c27650',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.162862] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-53a4d3c3-01ca-4828-94d1-6fa305c27650 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.162968] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-53a4d3c3-01ca-4828-94d1-6fa305c27650" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.163046] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-53a4d3c3-01ca-4828-94d1-6fa305c27650" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.163216] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-53a4d3c3-01ca-4828-94d1-6fa305c27650" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.163357] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.163444] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.163503] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.163636] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.165866] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.165866] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('53a4d3c3-01ca-4828-94d1-6fa305c27650',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.165866] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-39a6e13e-097d-4320-88ec-4558a53e8109 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.165866] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-39a6e13e-097d-4320-88ec-4558a53e8109" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.165866] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-39a6e13e-097d-4320-88ec-4558a53e8109" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.165866] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-39a6e13e-097d-4320-88ec-4558a53e8109" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.165866] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('39a6e13e-097d-4320-88ec-4558a53e8109',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.666871] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-53a4d3c3-01ca-4828-94d1-6fa305c27650 taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.667201] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-53a4d3c3-01ca-4828-94d1-6fa305c27650" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.667263] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('53a4d3c3-01ca-4828-94d1-6fa305c27650',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.668404] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 39a6e13e-097d-4320-88ec-4558a53e8109 with status ACTIVE [ 849.668506] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.668597] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.668733] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.668902] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.669038] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.669249] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.669357] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.669426] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.669587] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.669725] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.669944] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.670857] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.670857] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.670857] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.670857] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.670857] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 39a6e13e-097d-4320-88ec-4558a53e8109 is going to be updated. [ 849.694791] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.694791] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.694791] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.695034] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.695034] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.695106] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-39a6e13e-097d-4320-88ec-4558a53e8109" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.000774] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e6233127-d754-46c4-9840-1e77714a63d1 in Status: SUCCESS [ 850.001031] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e6233127-d754-46c4-9840-1e77714a63d1" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.001254] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e6233127-d754-46c4-9840-1e77714a63d1" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.001481] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e6233127-d754-46c4-9840-1e77714a63d1" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.001573] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e6233127-d754-46c4-9840-1e77714a63d1',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.178555] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('53a4d3c3-01ca-4828-94d1-6fa305c27650',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.260995] env[69188]: INFO networking_nsxv3.common.synchronization [req-e831d0f3-043c-44f7-ae67-87b3dcb7bba4 req-d8770673-af12-4c51-8a0c-b9a1f044252f tempest-ServersTestJSON-1495057482 tempest-ServersTestJSON-1495057482-project-member] Enqueued Resource ID: 9f2518e8-b195-4520-b262-caa765ab7e27 with Priority: HIGHEST for action security_group_members [ 850.261279] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f2518e8-b195-4520-b262-caa765ab7e27 with Priority: HIGHEST for action security_group_members [ 850.263043] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-9f2518e8-b195-4520-b262-caa765ab7e27 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.263043] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9f2518e8-b195-4520-b262-caa765ab7e27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.263043] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9f2518e8-b195-4520-b262-caa765ab7e27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.263043] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9f2518e8-b195-4520-b262-caa765ab7e27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.263043] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.263043] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.263043] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.263043] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.263043] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.263043] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9f2518e8-b195-4520-b262-caa765ab7e27',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.506297] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-e6233127-d754-46c4-9840-1e77714a63d1 taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.506467] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e6233127-d754-46c4-9840-1e77714a63d1" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.683585] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.683966] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.683966] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.684148] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.684222] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.684326] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 53a4d3c3-01ca-4828-94d1-6fa305c27650 is going to be created. [ 850.708455] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.708676] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.708765] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.709092] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.709632] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.716821] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock network-507 taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.717053] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "network-507" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.717163] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "network-507" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.717587] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "network-507" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.718092] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.718092] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.718283] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.718559] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.718708] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.718914] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 850.719056] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] NeedRegenerationException {{(pid=69188) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 850.719233] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] no value, waiting for create lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 850.719321] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] value creation lock acquired {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 850.719438] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 850.719544] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Calling creation function for not-yet-present value {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 850.719775] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 850.722072] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 53a4d3c3-01ca-4828-94d1-6fa305c27650 in Status: UNINITIALIZED for 2s [ 850.743470] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 850.743658] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=69188) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 850.743799] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Released creation lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 850.744199] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "network-507" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.744344] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock port-e3b368bc-f7ce-4880-8f17-706cc99a4ceb taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.744521] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "port-e3b368bc-f7ce-4880-8f17-706cc99a4ceb" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.744653] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "port-e3b368bc-f7ce-4880-8f17-706cc99a4ceb" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.745015] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "port-e3b368bc-f7ce-4880-8f17-706cc99a4ceb" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.745218] env[69188]: DEBUG networking_nsxv3.api.rpc [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e3b368bc-f7ce-4880-8f17-706cc99a4ceb',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.766723] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9f2518e8-b195-4520-b262-caa765ab7e27',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.945935] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e6233127-d754-46c4-9840-1e77714a63d1 in Status: SUCCESS [ 850.946078] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e6233127-d754-46c4-9840-1e77714a63d1" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.946256] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e6233127-d754-46c4-9840-1e77714a63d1" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.946513] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e6233127-d754-46c4-9840-1e77714a63d1" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.946710] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.946832] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.946900] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.947105] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.947193] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.947280] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e6233127-d754-46c4-9840-1e77714a63d1" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.947373] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e6233127-d754-46c4-9840-1e77714a63d1',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.248740] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.249100] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.249320] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.249701] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.249953] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.250220] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Segment Port e3b368bc-f7ce-4880-8f17-706cc99a4ceb not found, creating... [ 851.250582] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.250853] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.251080] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.251391] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.251613] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.251987] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.252254] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.252459] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.252747] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.252968] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.253206] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Resource: SegmentPort with ID: e3b368bc-f7ce-4880-8f17-706cc99a4ceb is going to be created. [ 851.268082] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9f2518e8-b195-4520-b262-caa765ab7e27',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.273493] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.273705] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.273837] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.274218] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.274544] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.274842] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "port-e3b368bc-f7ce-4880-8f17-706cc99a4ceb" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.449696] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-e6233127-d754-46c4-9840-1e77714a63d1 taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.449883] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e6233127-d754-46c4-9840-1e77714a63d1" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.449953] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e6233127-d754-46c4-9840-1e77714a63d1" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.450222] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e6233127-d754-46c4-9840-1e77714a63d1" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.450462] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.450582] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.450682] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.450875] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.450994] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.451142] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e6233127-d754-46c4-9840-1e77714a63d1" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.451313] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-e6233127-d754-46c4-9840-1e77714a63d1 taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.451767] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e6233127-d754-46c4-9840-1e77714a63d1" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.451866] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e6233127-d754-46c4-9840-1e77714a63d1" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.452071] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e6233127-d754-46c4-9840-1e77714a63d1" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.452259] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.452377] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.452466] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.452624] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.452729] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.453112] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e6233127-d754-46c4-9840-1e77714a63d1" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.453264] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e6233127-d754-46c4-9840-1e77714a63d1',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.770687] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.771029] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.771709] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.772600] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.772749] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.772902] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9f2518e8-b195-4520-b262-caa765ab7e27 is going to be updated. [ 851.803179] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.803399] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.803481] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.803700] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.803845] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.812845] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9f2518e8-b195-4520-b262-caa765ab7e27 in Status: IN_PROGRESS for 2s [ 851.930018] env[69188]: INFO networking_nsxv3.common.synchronization [req-2afc7e9f-6dcc-436a-8378-eed2b90e825e req-059bfacd-407b-4d96-884b-496f66f97855 tempest-ServersTestFqdnHostnames-463327493 tempest-ServersTestFqdnHostnames-463327493-project-member] Enqueued Resource ID: 43255fe7-9062-49a0-a8ff-2aab46177272 with Priority: HIGHEST for action security_group_members [ 851.930018] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 43255fe7-9062-49a0-a8ff-2aab46177272 with Priority: HIGHEST for action security_group_members [ 851.930235] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-43255fe7-9062-49a0-a8ff-2aab46177272 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.930533] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-43255fe7-9062-49a0-a8ff-2aab46177272" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.930731] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-43255fe7-9062-49a0-a8ff-2aab46177272" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.931064] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-43255fe7-9062-49a0-a8ff-2aab46177272" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.931494] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.933024] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.933024] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.933024] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.933024] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.933024] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('43255fe7-9062-49a0-a8ff-2aab46177272',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.957348] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e6233127-d754-46c4-9840-1e77714a63d1: rpc.has_security_group_logging(os_id): False [ 851.975020] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.975020] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.975020] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.975020] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.975020] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.975020] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.975020] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.975020] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.975020] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.975020] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.975020] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.975020] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.975020] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.975020] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.975020] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.975902] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.977043] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.977568] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.979489] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.979489] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.979489] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e6233127-d754-46c4-9840-1e77714a63d1 is going to be updated. [ 852.043944] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.043944] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.043944] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.043944] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.043944] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.059686] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e6233127-d754-46c4-9840-1e77714a63d1 in Status: IN_PROGRESS for 2s [ 852.062662] env[69188]: INFO networking_nsxv3.common.synchronization [req-e831d0f3-043c-44f7-ae67-87b3dcb7bba4 req-211cfe46-4197-4102-9a5b-7653557539e7 service nova] Enqueued Resource ID: 9f2518e8-b195-4520-b262-caa765ab7e27 with Priority: HIGHEST for action security_group_rules [ 852.063299] env[69188]: INFO networking_nsxv3.common.synchronization [req-e831d0f3-043c-44f7-ae67-87b3dcb7bba4 req-211cfe46-4197-4102-9a5b-7653557539e7 service nova] Enqueued Resource ID: 9f2518e8-b195-4520-b262-caa765ab7e27 with Priority: HIGHEST for action security_group_members [ 852.063299] env[69188]: INFO networking_nsxv3.common.synchronization [req-e831d0f3-043c-44f7-ae67-87b3dcb7bba4 req-211cfe46-4197-4102-9a5b-7653557539e7 service nova] Enqueued Resource ID: e3b368bc-f7ce-4880-8f17-706cc99a4ceb with Priority: HIGHEST for action port [ 852.063691] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f2518e8-b195-4520-b262-caa765ab7e27 with Priority: HIGHEST for action security_group_rules [ 852.063834] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f2518e8-b195-4520-b262-caa765ab7e27 with Priority: HIGHEST for action security_group_members [ 852.063952] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e3b368bc-f7ce-4880-8f17-706cc99a4ceb with Priority: HIGHEST for action port [ 852.064483] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9f2518e8-b195-4520-b262-caa765ab7e27 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.064640] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9f2518e8-b195-4520-b262-caa765ab7e27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.064727] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9f2518e8-b195-4520-b262-caa765ab7e27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.064980] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9f2518e8-b195-4520-b262-caa765ab7e27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.065218] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9f2518e8-b195-4520-b262-caa765ab7e27',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.066475] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-9f2518e8-b195-4520-b262-caa765ab7e27 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.066603] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9f2518e8-b195-4520-b262-caa765ab7e27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.067941] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-e3b368bc-f7ce-4880-8f17-706cc99a4ceb taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.067941] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e3b368bc-f7ce-4880-8f17-706cc99a4ceb" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.067941] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e3b368bc-f7ce-4880-8f17-706cc99a4ceb" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.067941] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e3b368bc-f7ce-4880-8f17-706cc99a4ceb" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.067941] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e3b368bc-f7ce-4880-8f17-706cc99a4ceb',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.249986] env[69188]: INFO networking_nsxv3.common.synchronization [req-209822e4-c354-4b95-bdae-a29348c5651b req-7b3cf7f3-e072-4140-a883-3f5b3f5993dc tempest-ServerDiskConfigTestJSON-1476779099 tempest-ServerDiskConfigTestJSON-1476779099-project-member] Enqueued Resource ID: 24a7b083-b432-46d6-94de-76adf6ce22b3 with Priority: HIGHEST for action security_group_members [ 852.250510] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 24a7b083-b432-46d6-94de-76adf6ce22b3 with Priority: HIGHEST for action security_group_members [ 852.250810] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-24a7b083-b432-46d6-94de-76adf6ce22b3 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.250944] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-24a7b083-b432-46d6-94de-76adf6ce22b3" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.251026] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-24a7b083-b432-46d6-94de-76adf6ce22b3" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.251258] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-24a7b083-b432-46d6-94de-76adf6ce22b3" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.251693] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.251807] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.251874] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.252525] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.252695] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.252834] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('24a7b083-b432-46d6-94de-76adf6ce22b3',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.527663] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.527804] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.527870] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.528149] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.528244] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.528430] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.528520] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.528576] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.528717] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.528785] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.528865] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 43255fe7-9062-49a0-a8ff-2aab46177272 is going to be updated. [ 852.568800] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-9f2518e8-b195-4520-b262-caa765ab7e27 taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.568938] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9f2518e8-b195-4520-b262-caa765ab7e27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.569160] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e3b368bc-f7ce-4880-8f17-706cc99a4ceb with status ACTIVE [ 852.569329] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.569435] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.569501] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.569698] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.569782] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.569965] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.570089] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.570149] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.570361] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.570451] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.570633] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.570721] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.570780] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.570911] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.570982] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.571075] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e3b368bc-f7ce-4880-8f17-706cc99a4ceb is going to be updated. [ 852.621264] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.621439] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.621492] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.621692] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.621828] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.629291] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 43255fe7-9062-49a0-a8ff-2aab46177272 in Status: IN_PROGRESS for 2s [ 852.637016] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.637242] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.637361] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.637816] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.637816] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.638086] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e3b368bc-f7ce-4880-8f17-706cc99a4ceb" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.743244] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 53a4d3c3-01ca-4828-94d1-6fa305c27650 in Status: SUCCESS [ 852.743426] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-53a4d3c3-01ca-4828-94d1-6fa305c27650" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.743596] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-53a4d3c3-01ca-4828-94d1-6fa305c27650" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.743809] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-53a4d3c3-01ca-4828-94d1-6fa305c27650" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.744036] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.744158] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.744221] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.744365] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.744444] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.744522] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-53a4d3c3-01ca-4828-94d1-6fa305c27650" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.744664] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('53a4d3c3-01ca-4828-94d1-6fa305c27650',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.755455] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.755455] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.755455] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.755455] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.755811] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.755811] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.755811] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.755811] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.755995] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.756053] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.756147] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 24a7b083-b432-46d6-94de-76adf6ce22b3 is going to be updated. [ 852.760974] env[69188]: INFO networking_nsxv3.common.synchronization [req-ab40ee85-45dc-4342-a58c-94c2e8240911 req-86cd3382-9941-4d50-96e5-6f32015e04c6 tempest-SecurityGroupsTestJSON-1621209229 tempest-SecurityGroupsTestJSON-1621209229-project-member] Enqueued Resource ID: b99e414b-ff9c-4d19-b3c8-32ab58288d75 with Priority: HIGHEST for action security_group_members [ 852.761386] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b99e414b-ff9c-4d19-b3c8-32ab58288d75 with Priority: HIGHEST for action security_group_members [ 852.761660] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-b99e414b-ff9c-4d19-b3c8-32ab58288d75 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.761764] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b99e414b-ff9c-4d19-b3c8-32ab58288d75" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.761827] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b99e414b-ff9c-4d19-b3c8-32ab58288d75" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.762043] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b99e414b-ff9c-4d19-b3c8-32ab58288d75" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.762191] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.762307] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.762382] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.762548] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.762626] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.762715] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b99e414b-ff9c-4d19-b3c8-32ab58288d75',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.805111] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.805781] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.805781] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.805781] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.805781] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.814941] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 24a7b083-b432-46d6-94de-76adf6ce22b3 in Status: IN_PROGRESS for 2s [ 853.209824] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock network-88 taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.209824] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "network-88" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.209824] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "network-88" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.209824] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "network-88" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.210028] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.210028] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.210214] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.211218] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.211218] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.211728] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 853.211783] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] NeedRegenerationException {{(pid=69188) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 853.211910] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] no value, waiting for create lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 853.212043] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] value creation lock acquired {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 853.251806] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 853.251806] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Calling creation function for not-yet-present value {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 853.251806] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 853.251806] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 853.251806] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69188) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 853.251806] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Released creation lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 853.251806] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "network-88" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.251806] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock port-91083377-9e3a-442b-947a-8b5ac6ea05d1 taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.251806] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "port-91083377-9e3a-442b-947a-8b5ac6ea05d1" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.251806] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "port-91083377-9e3a-442b-947a-8b5ac6ea05d1" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.251806] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "port-91083377-9e3a-442b-947a-8b5ac6ea05d1" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.251806] env[69188]: DEBUG networking_nsxv3.api.rpc [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('91083377-9e3a-442b-947a-8b5ac6ea05d1',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.251806] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-53a4d3c3-01ca-4828-94d1-6fa305c27650 taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.251806] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-53a4d3c3-01ca-4828-94d1-6fa305c27650" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.251806] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-53a4d3c3-01ca-4828-94d1-6fa305c27650" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.251806] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-53a4d3c3-01ca-4828-94d1-6fa305c27650" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.253039] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.253039] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.253039] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.253039] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.253039] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.253039] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-53a4d3c3-01ca-4828-94d1-6fa305c27650" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.253039] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-53a4d3c3-01ca-4828-94d1-6fa305c27650 taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.253039] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-53a4d3c3-01ca-4828-94d1-6fa305c27650" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.253039] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-53a4d3c3-01ca-4828-94d1-6fa305c27650" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.253039] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-53a4d3c3-01ca-4828-94d1-6fa305c27650" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.253039] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.253039] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.253039] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.253039] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.253039] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.253039] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-53a4d3c3-01ca-4828-94d1-6fa305c27650" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.253039] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('53a4d3c3-01ca-4828-94d1-6fa305c27650',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.265934] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.265934] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.265934] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.265934] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.265934] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.266119] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.266180] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.266218] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.266378] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.266449] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.269622] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b99e414b-ff9c-4d19-b3c8-32ab58288d75 already deleted. [ 853.269622] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b99e414b-ff9c-4d19-b3c8-32ab58288d75" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.737695] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.737936] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.738114] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.738436] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.738609] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.738784] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Segment Port 91083377-9e3a-442b-947a-8b5ac6ea05d1 not found, creating... [ 853.739121] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.739301] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.739440] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.739694] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.739863] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.740888] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.740888] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.740888] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.740888] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.741070] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.741262] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Resource: SegmentPort with ID: 91083377-9e3a-442b-947a-8b5ac6ea05d1 is going to be created. [ 853.752798] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 53a4d3c3-01ca-4828-94d1-6fa305c27650: rpc.has_security_group_logging(os_id): False [ 853.762909] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.763134] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.763259] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.763527] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.763754] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.766896] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "port-91083377-9e3a-442b-947a-8b5ac6ea05d1" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.769321] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.769442] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.769513] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.769698] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.769857] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.770092] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.770198] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.770261] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.771180] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.771298] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.771492] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.771596] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.771660] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.771810] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.771888] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.772098] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.772785] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.772865] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.773038] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.773126] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.773220] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 53a4d3c3-01ca-4828-94d1-6fa305c27650 is going to be created. [ 853.823801] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9f2518e8-b195-4520-b262-caa765ab7e27 in Status: SUCCESS [ 853.824102] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9f2518e8-b195-4520-b262-caa765ab7e27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.824210] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9f2518e8-b195-4520-b262-caa765ab7e27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.824432] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9f2518e8-b195-4520-b262-caa765ab7e27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.824622] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.824753] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.824802] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.824953] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.825079] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.825182] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9f2518e8-b195-4520-b262-caa765ab7e27',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.831463] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.831591] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.831659] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.831829] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.831996] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.846031] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 53a4d3c3-01ca-4828-94d1-6fa305c27650 in Status: IN_PROGRESS for 2s [ 854.071848] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e6233127-d754-46c4-9840-1e77714a63d1 in Status: SUCCESS [ 854.072099] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e6233127-d754-46c4-9840-1e77714a63d1" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.328379] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9f2518e8-b195-4520-b262-caa765ab7e27',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 854.526327] env[69188]: INFO networking_nsxv3.common.synchronization [req-ab40ee85-45dc-4342-a58c-94c2e8240911 req-285bfc9b-11e4-4fdb-9a35-8dc4d60c10e4 service nova] Enqueued Resource ID: b99e414b-ff9c-4d19-b3c8-32ab58288d75 with Priority: HIGHEST for action security_group_rules [ 854.527614] env[69188]: INFO networking_nsxv3.common.synchronization [req-ab40ee85-45dc-4342-a58c-94c2e8240911 req-285bfc9b-11e4-4fdb-9a35-8dc4d60c10e4 service nova] Enqueued Resource ID: b99e414b-ff9c-4d19-b3c8-32ab58288d75 with Priority: HIGHEST for action security_group_members [ 854.527614] env[69188]: INFO networking_nsxv3.common.synchronization [req-ab40ee85-45dc-4342-a58c-94c2e8240911 req-285bfc9b-11e4-4fdb-9a35-8dc4d60c10e4 service nova] Enqueued Resource ID: 91083377-9e3a-442b-947a-8b5ac6ea05d1 with Priority: HIGHEST for action port [ 854.527614] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b99e414b-ff9c-4d19-b3c8-32ab58288d75 with Priority: HIGHEST for action security_group_rules [ 854.527614] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b99e414b-ff9c-4d19-b3c8-32ab58288d75 with Priority: HIGHEST for action security_group_members [ 854.527614] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 91083377-9e3a-442b-947a-8b5ac6ea05d1 with Priority: HIGHEST for action port [ 854.527780] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b99e414b-ff9c-4d19-b3c8-32ab58288d75 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.527780] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b99e414b-ff9c-4d19-b3c8-32ab58288d75" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.527870] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b99e414b-ff9c-4d19-b3c8-32ab58288d75" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.529229] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b99e414b-ff9c-4d19-b3c8-32ab58288d75" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.529229] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b99e414b-ff9c-4d19-b3c8-32ab58288d75',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 854.529229] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-b99e414b-ff9c-4d19-b3c8-32ab58288d75 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.529384] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b99e414b-ff9c-4d19-b3c8-32ab58288d75" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.529384] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b99e414b-ff9c-4d19-b3c8-32ab58288d75" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.529770] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b99e414b-ff9c-4d19-b3c8-32ab58288d75" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.529770] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.529770] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.529988] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.529988] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.530082] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.530122] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b99e414b-ff9c-4d19-b3c8-32ab58288d75',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 854.530913] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-91083377-9e3a-442b-947a-8b5ac6ea05d1 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.531034] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-91083377-9e3a-442b-947a-8b5ac6ea05d1" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.531034] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-91083377-9e3a-442b-947a-8b5ac6ea05d1" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.531188] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-91083377-9e3a-442b-947a-8b5ac6ea05d1" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.531257] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('91083377-9e3a-442b-947a-8b5ac6ea05d1',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 854.639406] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 43255fe7-9062-49a0-a8ff-2aab46177272 in Status: SUCCESS [ 854.639406] env[69188]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 43255fe7-9062-49a0-a8ff-2aab46177272 deletion is rescheduled due to dependency. [ 854.639406] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-43255fe7-9062-49a0-a8ff-2aab46177272" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.826701] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 24a7b083-b432-46d6-94de-76adf6ce22b3 in Status: SUCCESS [ 854.826701] env[69188]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 24a7b083-b432-46d6-94de-76adf6ce22b3 deletion is rescheduled due to dependency. [ 854.826701] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-24a7b083-b432-46d6-94de-76adf6ce22b3" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.831574] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9f2518e8-b195-4520-b262-caa765ab7e27',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.033303] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b99e414b-ff9c-4d19-b3c8-32ab58288d75',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.039623] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-b99e414b-ff9c-4d19-b3c8-32ab58288d75 taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.039789] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b99e414b-ff9c-4d19-b3c8-32ab58288d75" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.040019] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 91083377-9e3a-442b-947a-8b5ac6ea05d1 with status ACTIVE [ 855.040229] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.040391] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.040391] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.045733] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.045733] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.045733] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.045733] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.045733] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.045733] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.045733] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.045733] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.045733] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.045733] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.045733] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.045733] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.045733] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 91083377-9e3a-442b-947a-8b5ac6ea05d1 is going to be updated. [ 855.072189] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.072189] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.072189] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.072382] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.072409] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.072590] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-91083377-9e3a-442b-947a-8b5ac6ea05d1" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.333528] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.333683] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.333751] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.334114] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.334205] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.334308] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9f2518e8-b195-4520-b262-caa765ab7e27 is going to be updated. [ 855.391114] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.391274] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.391335] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.391557] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.391700] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.404371] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9f2518e8-b195-4520-b262-caa765ab7e27 in Status: IN_PROGRESS for 2s [ 855.539982] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b99e414b-ff9c-4d19-b3c8-32ab58288d75',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.860137] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 53a4d3c3-01ca-4828-94d1-6fa305c27650 in Status: SUCCESS [ 855.860137] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-53a4d3c3-01ca-4828-94d1-6fa305c27650" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.047079] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.047079] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.047079] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.047079] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.047079] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.047079] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b99e414b-ff9c-4d19-b3c8-32ab58288d75 is going to be created. [ 856.073688] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.073836] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.073908] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.074143] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.074308] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.085143] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b99e414b-ff9c-4d19-b3c8-32ab58288d75 in Status: UNINITIALIZED for 2s [ 857.413290] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9f2518e8-b195-4520-b262-caa765ab7e27 in Status: SUCCESS [ 857.414324] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9f2518e8-b195-4520-b262-caa765ab7e27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.415031] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9f2518e8-b195-4520-b262-caa765ab7e27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.415031] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9f2518e8-b195-4520-b262-caa765ab7e27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.415031] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.415341] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.415436] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.415601] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.415683] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.415769] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9f2518e8-b195-4520-b262-caa765ab7e27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.415859] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9f2518e8-b195-4520-b262-caa765ab7e27',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.919942] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-9f2518e8-b195-4520-b262-caa765ab7e27 taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.920115] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9f2518e8-b195-4520-b262-caa765ab7e27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.920226] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9f2518e8-b195-4520-b262-caa765ab7e27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.920439] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9f2518e8-b195-4520-b262-caa765ab7e27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.920641] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.920772] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.920839] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.920992] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.921093] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.921185] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9f2518e8-b195-4520-b262-caa765ab7e27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.921368] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-9f2518e8-b195-4520-b262-caa765ab7e27 taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.921471] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9f2518e8-b195-4520-b262-caa765ab7e27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.921543] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9f2518e8-b195-4520-b262-caa765ab7e27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.921792] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9f2518e8-b195-4520-b262-caa765ab7e27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.921902] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.922062] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.922168] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.922289] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.922367] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.922448] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9f2518e8-b195-4520-b262-caa765ab7e27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.922541] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9f2518e8-b195-4520-b262-caa765ab7e27',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.095655] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b99e414b-ff9c-4d19-b3c8-32ab58288d75 in Status: SUCCESS [ 858.096092] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b99e414b-ff9c-4d19-b3c8-32ab58288d75" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.096825] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b99e414b-ff9c-4d19-b3c8-32ab58288d75" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.097151] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b99e414b-ff9c-4d19-b3c8-32ab58288d75" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.097402] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.097557] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.097645] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.097841] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.098120] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.098120] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b99e414b-ff9c-4d19-b3c8-32ab58288d75" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.098226] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b99e414b-ff9c-4d19-b3c8-32ab58288d75',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.427529] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9f2518e8-b195-4520-b262-caa765ab7e27: rpc.has_security_group_logging(os_id): False [ 858.450140] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.450213] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.450241] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.451361] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.451361] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.451361] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.451361] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.451361] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.451361] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.451361] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.451361] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.451361] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.451723] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.451723] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.451723] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.451802] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.452602] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.452602] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.452602] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.452602] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.452602] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9f2518e8-b195-4520-b262-caa765ab7e27 is going to be updated. [ 858.509644] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.509934] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.510075] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.510373] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.510574] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.524611] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9f2518e8-b195-4520-b262-caa765ab7e27 in Status: IN_PROGRESS for 2s [ 858.603330] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-b99e414b-ff9c-4d19-b3c8-32ab58288d75 taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.603557] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b99e414b-ff9c-4d19-b3c8-32ab58288d75" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.603557] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b99e414b-ff9c-4d19-b3c8-32ab58288d75" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.605060] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b99e414b-ff9c-4d19-b3c8-32ab58288d75" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.605060] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.605060] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.605060] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.605060] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.605060] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.605060] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b99e414b-ff9c-4d19-b3c8-32ab58288d75" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.605060] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-b99e414b-ff9c-4d19-b3c8-32ab58288d75 taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.605060] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b99e414b-ff9c-4d19-b3c8-32ab58288d75" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.605060] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b99e414b-ff9c-4d19-b3c8-32ab58288d75" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.605060] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b99e414b-ff9c-4d19-b3c8-32ab58288d75" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.605060] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.605060] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.605060] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.605709] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.605709] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.605709] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b99e414b-ff9c-4d19-b3c8-32ab58288d75" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.605709] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b99e414b-ff9c-4d19-b3c8-32ab58288d75',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.107871] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b99e414b-ff9c-4d19-b3c8-32ab58288d75: rpc.has_security_group_logging(os_id): False [ 859.125738] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.125925] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.126090] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.126740] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.126740] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.127055] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.127757] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.127757] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.127757] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.127757] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.128508] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.128508] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.128508] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.128743] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.129502] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.129502] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.129502] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.129502] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.129867] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.129912] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.130079] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b99e414b-ff9c-4d19-b3c8-32ab58288d75 is going to be created. [ 859.205027] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.205027] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.205027] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.205027] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.205027] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.215627] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b99e414b-ff9c-4d19-b3c8-32ab58288d75 in Status: IN_PROGRESS for 2s [ 859.528560] env[69188]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 859.528842] env[69188]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 860.537763] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9f2518e8-b195-4520-b262-caa765ab7e27 in Status: SUCCESS [ 860.538031] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9f2518e8-b195-4520-b262-caa765ab7e27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.229946] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b99e414b-ff9c-4d19-b3c8-32ab58288d75 in Status: SUCCESS [ 861.229946] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b99e414b-ff9c-4d19-b3c8-32ab58288d75" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.681209] env[69188]: INFO networking_nsxv3.common.synchronization [req-5482427a-04dc-4e96-9900-db35c383f4f0 req-fe7eefae-a760-4587-a614-1e65b0cd0f9e tempest-ServerRescueTestJSON-1501419910 tempest-ServerRescueTestJSON-1501419910-project-member] Enqueued Resource ID: 143fbb10-efe2-4f17-a012-d41cc9b595b6 with Priority: HIGHEST for action security_group_members [ 861.681209] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 143fbb10-efe2-4f17-a012-d41cc9b595b6 with Priority: HIGHEST for action security_group_members [ 861.681564] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-143fbb10-efe2-4f17-a012-d41cc9b595b6 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.681729] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-143fbb10-efe2-4f17-a012-d41cc9b595b6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.681832] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-143fbb10-efe2-4f17-a012-d41cc9b595b6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.683146] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-143fbb10-efe2-4f17-a012-d41cc9b595b6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.683146] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.683146] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.683146] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.683146] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.683146] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.683146] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('143fbb10-efe2-4f17-a012-d41cc9b595b6',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 862.028489] env[69188]: INFO networking_nsxv3.common.synchronization [req-28b3d53b-cef8-4533-814d-9560019327a2 req-c6b78a24-4751-4d9e-aa2f-12ef8c15665b tempest-MultipleCreateTestJSON-27366217 tempest-MultipleCreateTestJSON-27366217-project-member] Enqueued Resource ID: 7f98bc00-dbd3-411c-a67a-14369145489a with Priority: HIGHEST for action security_group_members [ 862.028829] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f98bc00-dbd3-411c-a67a-14369145489a with Priority: HIGHEST for action security_group_members [ 862.029165] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-7f98bc00-dbd3-411c-a67a-14369145489a taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.029292] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7f98bc00-dbd3-411c-a67a-14369145489a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.029357] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7f98bc00-dbd3-411c-a67a-14369145489a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.029549] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7f98bc00-dbd3-411c-a67a-14369145489a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.029705] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.030623] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.030623] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.030623] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.030623] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.030623] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7f98bc00-dbd3-411c-a67a-14369145489a',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 862.190155] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.190155] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.190155] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.190155] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.190155] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.190155] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.190489] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.190489] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.190547] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.190629] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.190752] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 143fbb10-efe2-4f17-a012-d41cc9b595b6 is going to be updated. [ 862.216896] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.217050] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.217116] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.217322] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.217463] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.226496] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 143fbb10-efe2-4f17-a012-d41cc9b595b6 in Status: IN_PROGRESS for 2s [ 862.444045] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock network-434 taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.444045] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "network-434" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.444373] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "network-434" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.444739] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "network-434" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.445122] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.446050] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.446050] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.446050] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.446050] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.446344] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 862.446536] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] NeedRegenerationException {{(pid=69188) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 862.447268] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] no value, waiting for create lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 862.447268] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] value creation lock acquired {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 862.447268] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 862.447268] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Calling creation function for not-yet-present value {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 862.447268] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 862.465509] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 862.465695] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69188) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 862.465839] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Released creation lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 862.466042] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "network-434" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.466371] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock port-03bef75e-6f14-45da-a1a6-a59b55c161e3 taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.466547] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "port-03bef75e-6f14-45da-a1a6-a59b55c161e3" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.466669] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "port-03bef75e-6f14-45da-a1a6-a59b55c161e3" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.467027] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "port-03bef75e-6f14-45da-a1a6-a59b55c161e3" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.467176] env[69188]: DEBUG networking_nsxv3.api.rpc [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('03bef75e-6f14-45da-a1a6-a59b55c161e3',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 862.533026] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.533026] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.533026] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.533310] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.533383] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.533638] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.534780] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.534780] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.534780] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.534780] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.534780] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7f98bc00-dbd3-411c-a67a-14369145489a is going to be deleted. [ 862.559065] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.559282] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.559353] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.559584] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.559671] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.559771] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7f98bc00-dbd3-411c-a67a-14369145489a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.971907] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.972349] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.972349] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.972689] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.973318] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.973318] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Segment Port 03bef75e-6f14-45da-a1a6-a59b55c161e3 not found, creating... [ 862.973318] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.973489] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.973590] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.973877] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.974068] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.974399] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.974596] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.974747] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.974989] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.975188] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.975377] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Resource: SegmentPort with ID: 03bef75e-6f14-45da-a1a6-a59b55c161e3 is going to be created. [ 862.994836] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.995051] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.995254] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.995531] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.995763] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.995997] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "port-03bef75e-6f14-45da-a1a6-a59b55c161e3" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.430692] env[69188]: INFO networking_nsxv3.common.synchronization [req-02851a65-6b17-4f56-82cf-797ff18dfc2f req-4e0e9aec-4468-4415-8d59-045782ab0eb7 tempest-SecurityGroupsTestJSON-1621209229 tempest-SecurityGroupsTestJSON-1621209229-project-member] Enqueued Resource ID: b99e414b-ff9c-4d19-b3c8-32ab58288d75 with Priority: HIGHEST for action security_group_members [ 863.430935] env[69188]: INFO networking_nsxv3.common.synchronization [req-02851a65-6b17-4f56-82cf-797ff18dfc2f req-4e0e9aec-4468-4415-8d59-045782ab0eb7 tempest-SecurityGroupsTestJSON-1621209229 tempest-SecurityGroupsTestJSON-1621209229-project-member] Enqueued Resource ID: e275bda6-f504-45ea-9805-84ac49a67aa7 with Priority: HIGHEST for action security_group_members [ 863.431749] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b99e414b-ff9c-4d19-b3c8-32ab58288d75 with Priority: HIGHEST for action security_group_members [ 863.431749] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e275bda6-f504-45ea-9805-84ac49a67aa7 with Priority: HIGHEST for action security_group_members [ 863.432022] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-b99e414b-ff9c-4d19-b3c8-32ab58288d75 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.432221] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b99e414b-ff9c-4d19-b3c8-32ab58288d75" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.432368] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b99e414b-ff9c-4d19-b3c8-32ab58288d75" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.432581] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b99e414b-ff9c-4d19-b3c8-32ab58288d75" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.432822] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.432937] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.433038] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.433256] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.433419] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.433630] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b99e414b-ff9c-4d19-b3c8-32ab58288d75',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 863.434557] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-e275bda6-f504-45ea-9805-84ac49a67aa7 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.434762] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e275bda6-f504-45ea-9805-84ac49a67aa7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.434877] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e275bda6-f504-45ea-9805-84ac49a67aa7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.435824] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e275bda6-f504-45ea-9805-84ac49a67aa7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.435824] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.435824] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.435824] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.435824] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.435824] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.435824] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e275bda6-f504-45ea-9805-84ac49a67aa7',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 863.481841] env[69188]: INFO networking_nsxv3.common.synchronization [req-02851a65-6b17-4f56-82cf-797ff18dfc2f req-4e0e9aec-4468-4415-8d59-045782ab0eb7 tempest-SecurityGroupsTestJSON-1621209229 tempest-SecurityGroupsTestJSON-1621209229-project-member] Enqueued Resource ID: b99e414b-ff9c-4d19-b3c8-32ab58288d75 with Priority: HIGHEST for action security_group_rules [ 863.482045] env[69188]: INFO networking_nsxv3.common.synchronization [req-02851a65-6b17-4f56-82cf-797ff18dfc2f req-4e0e9aec-4468-4415-8d59-045782ab0eb7 tempest-SecurityGroupsTestJSON-1621209229 tempest-SecurityGroupsTestJSON-1621209229-project-member] Enqueued Resource ID: b99e414b-ff9c-4d19-b3c8-32ab58288d75 with Priority: HIGHEST for action security_group_members [ 863.482269] env[69188]: INFO networking_nsxv3.common.synchronization [req-02851a65-6b17-4f56-82cf-797ff18dfc2f req-4e0e9aec-4468-4415-8d59-045782ab0eb7 tempest-SecurityGroupsTestJSON-1621209229 tempest-SecurityGroupsTestJSON-1621209229-project-member] Enqueued Resource ID: e275bda6-f504-45ea-9805-84ac49a67aa7 with Priority: HIGHEST for action security_group_rules [ 863.482606] env[69188]: INFO networking_nsxv3.common.synchronization [req-02851a65-6b17-4f56-82cf-797ff18dfc2f req-4e0e9aec-4468-4415-8d59-045782ab0eb7 tempest-SecurityGroupsTestJSON-1621209229 tempest-SecurityGroupsTestJSON-1621209229-project-member] Enqueued Resource ID: e275bda6-f504-45ea-9805-84ac49a67aa7 with Priority: HIGHEST for action security_group_members [ 863.482606] env[69188]: INFO networking_nsxv3.common.synchronization [req-02851a65-6b17-4f56-82cf-797ff18dfc2f req-4e0e9aec-4468-4415-8d59-045782ab0eb7 tempest-SecurityGroupsTestJSON-1621209229 tempest-SecurityGroupsTestJSON-1621209229-project-member] Enqueued Resource ID: 91083377-9e3a-442b-947a-8b5ac6ea05d1 with Priority: HIGHEST for action port [ 863.483301] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b99e414b-ff9c-4d19-b3c8-32ab58288d75 with Priority: HIGHEST for action security_group_rules [ 863.483461] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e275bda6-f504-45ea-9805-84ac49a67aa7 with Priority: HIGHEST for action security_group_rules [ 863.483688] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 91083377-9e3a-442b-947a-8b5ac6ea05d1 with Priority: HIGHEST for action port [ 863.483688] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b99e414b-ff9c-4d19-b3c8-32ab58288d75 with Priority: HIGHEST for action security_group_members [ 863.483815] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e275bda6-f504-45ea-9805-84ac49a67aa7 with Priority: HIGHEST for action security_group_members [ 863.484198] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b99e414b-ff9c-4d19-b3c8-32ab58288d75 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.484516] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b99e414b-ff9c-4d19-b3c8-32ab58288d75" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.484601] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b99e414b-ff9c-4d19-b3c8-32ab58288d75" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.484936] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b99e414b-ff9c-4d19-b3c8-32ab58288d75" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.485127] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b99e414b-ff9c-4d19-b3c8-32ab58288d75',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 863.486092] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e275bda6-f504-45ea-9805-84ac49a67aa7 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.489852] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e275bda6-f504-45ea-9805-84ac49a67aa7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.489852] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e275bda6-f504-45ea-9805-84ac49a67aa7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.489852] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e275bda6-f504-45ea-9805-84ac49a67aa7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.489852] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e275bda6-f504-45ea-9805-84ac49a67aa7',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 863.489852] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-91083377-9e3a-442b-947a-8b5ac6ea05d1 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.489852] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-91083377-9e3a-442b-947a-8b5ac6ea05d1" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.489852] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-91083377-9e3a-442b-947a-8b5ac6ea05d1" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.489852] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-91083377-9e3a-442b-947a-8b5ac6ea05d1" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.489852] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('91083377-9e3a-442b-947a-8b5ac6ea05d1',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 863.489852] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-b99e414b-ff9c-4d19-b3c8-32ab58288d75 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.489852] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b99e414b-ff9c-4d19-b3c8-32ab58288d75" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.489852] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-e275bda6-f504-45ea-9805-84ac49a67aa7 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.489852] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e275bda6-f504-45ea-9805-84ac49a67aa7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.808771] env[69188]: INFO networking_nsxv3.common.synchronization [req-28b3d53b-cef8-4533-814d-9560019327a2 req-0e16da18-6833-4ecc-80f2-5f0ced630f6a service nova] Enqueued Resource ID: 7f98bc00-dbd3-411c-a67a-14369145489a with Priority: HIGHEST for action security_group_rules [ 863.808771] env[69188]: INFO networking_nsxv3.common.synchronization [req-28b3d53b-cef8-4533-814d-9560019327a2 req-0e16da18-6833-4ecc-80f2-5f0ced630f6a service nova] Enqueued Resource ID: 7f98bc00-dbd3-411c-a67a-14369145489a with Priority: HIGHEST for action security_group_members [ 863.808771] env[69188]: INFO networking_nsxv3.common.synchronization [req-28b3d53b-cef8-4533-814d-9560019327a2 req-0e16da18-6833-4ecc-80f2-5f0ced630f6a service nova] Enqueued Resource ID: 03bef75e-6f14-45da-a1a6-a59b55c161e3 with Priority: HIGHEST for action port [ 863.808771] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f98bc00-dbd3-411c-a67a-14369145489a with Priority: HIGHEST for action security_group_rules [ 863.808771] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f98bc00-dbd3-411c-a67a-14369145489a with Priority: HIGHEST for action security_group_members [ 863.808771] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 03bef75e-6f14-45da-a1a6-a59b55c161e3 with Priority: HIGHEST for action port [ 863.809398] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7f98bc00-dbd3-411c-a67a-14369145489a taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.810211] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7f98bc00-dbd3-411c-a67a-14369145489a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.810424] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7f98bc00-dbd3-411c-a67a-14369145489a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.813019] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7f98bc00-dbd3-411c-a67a-14369145489a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.813019] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7f98bc00-dbd3-411c-a67a-14369145489a',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 863.813019] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-7f98bc00-dbd3-411c-a67a-14369145489a taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.813019] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7f98bc00-dbd3-411c-a67a-14369145489a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.813019] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7f98bc00-dbd3-411c-a67a-14369145489a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.813019] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7f98bc00-dbd3-411c-a67a-14369145489a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.813019] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.813019] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.813019] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.813019] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.813019] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.813019] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7f98bc00-dbd3-411c-a67a-14369145489a',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 863.814816] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-03bef75e-6f14-45da-a1a6-a59b55c161e3 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.814905] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-03bef75e-6f14-45da-a1a6-a59b55c161e3" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.814954] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-03bef75e-6f14-45da-a1a6-a59b55c161e3" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.815129] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-03bef75e-6f14-45da-a1a6-a59b55c161e3" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.818247] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('03bef75e-6f14-45da-a1a6-a59b55c161e3',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 863.937776] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b99e414b-ff9c-4d19-b3c8-32ab58288d75',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 863.939572] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e275bda6-f504-45ea-9805-84ac49a67aa7',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 863.990793] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-b99e414b-ff9c-4d19-b3c8-32ab58288d75 taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.990793] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b99e414b-ff9c-4d19-b3c8-32ab58288d75" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.991796] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 91083377-9e3a-442b-947a-8b5ac6ea05d1 with status ACTIVE [ 863.991952] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.992073] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.992073] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.992259] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.992351] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.992526] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.992622] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.992684] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.992835] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.992901] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.993098] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.993199] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.993317] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.993378] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.993463] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.993587] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 91083377-9e3a-442b-947a-8b5ac6ea05d1 is going to be updated. [ 863.994749] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-e275bda6-f504-45ea-9805-84ac49a67aa7 taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.994832] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e275bda6-f504-45ea-9805-84ac49a67aa7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.013503] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.013679] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.013742] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.013925] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.014080] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.014268] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-91083377-9e3a-442b-947a-8b5ac6ea05d1" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.038018] env[69188]: INFO networking_nsxv3.common.synchronization [req-84532e18-e3aa-4a11-affa-bba465cf2e90 req-3ebfefda-743a-44a4-9ba5-2d7093cf0bb0 tempest-SecurityGroupsTestJSON-1621209229 tempest-SecurityGroupsTestJSON-1621209229-project-member] Enqueued Resource ID: b99e414b-ff9c-4d19-b3c8-32ab58288d75 with Priority: HIGHEST for action security_group_members [ 864.038018] env[69188]: INFO networking_nsxv3.common.synchronization [req-84532e18-e3aa-4a11-affa-bba465cf2e90 req-3ebfefda-743a-44a4-9ba5-2d7093cf0bb0 tempest-SecurityGroupsTestJSON-1621209229 tempest-SecurityGroupsTestJSON-1621209229-project-member] Enqueued Resource ID: 166e7c17-8917-425e-9cd8-0580f8aa3e74 with Priority: HIGHEST for action security_group_members [ 864.038018] env[69188]: INFO networking_nsxv3.common.synchronization [req-84532e18-e3aa-4a11-affa-bba465cf2e90 req-3ebfefda-743a-44a4-9ba5-2d7093cf0bb0 tempest-SecurityGroupsTestJSON-1621209229 tempest-SecurityGroupsTestJSON-1621209229-project-member] Enqueued Resource ID: e275bda6-f504-45ea-9805-84ac49a67aa7 with Priority: HIGHEST for action security_group_members [ 864.038018] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b99e414b-ff9c-4d19-b3c8-32ab58288d75 with Priority: HIGHEST for action security_group_members [ 864.038018] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 166e7c17-8917-425e-9cd8-0580f8aa3e74 with Priority: HIGHEST for action security_group_members [ 864.040293] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e275bda6-f504-45ea-9805-84ac49a67aa7 with Priority: HIGHEST for action security_group_members [ 864.040293] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-b99e414b-ff9c-4d19-b3c8-32ab58288d75 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.040293] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b99e414b-ff9c-4d19-b3c8-32ab58288d75" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.040613] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-166e7c17-8917-425e-9cd8-0580f8aa3e74 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.040773] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-166e7c17-8917-425e-9cd8-0580f8aa3e74" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.040846] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-166e7c17-8917-425e-9cd8-0580f8aa3e74" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.041159] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-166e7c17-8917-425e-9cd8-0580f8aa3e74" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.041286] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.041369] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.041469] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.041626] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.041703] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.041769] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('166e7c17-8917-425e-9cd8-0580f8aa3e74',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.043636] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-e275bda6-f504-45ea-9805-84ac49a67aa7 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.043636] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e275bda6-f504-45ea-9805-84ac49a67aa7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.138374] env[69188]: INFO networking_nsxv3.common.synchronization [req-84532e18-e3aa-4a11-affa-bba465cf2e90 req-3ebfefda-743a-44a4-9ba5-2d7093cf0bb0 tempest-SecurityGroupsTestJSON-1621209229 tempest-SecurityGroupsTestJSON-1621209229-project-member] Enqueued Resource ID: 166e7c17-8917-425e-9cd8-0580f8aa3e74 with Priority: HIGHEST for action security_group_rules [ 864.138760] env[69188]: INFO networking_nsxv3.common.synchronization [req-84532e18-e3aa-4a11-affa-bba465cf2e90 req-3ebfefda-743a-44a4-9ba5-2d7093cf0bb0 tempest-SecurityGroupsTestJSON-1621209229 tempest-SecurityGroupsTestJSON-1621209229-project-member] Enqueued Resource ID: 166e7c17-8917-425e-9cd8-0580f8aa3e74 with Priority: HIGHEST for action security_group_members [ 864.138760] env[69188]: INFO networking_nsxv3.common.synchronization [req-84532e18-e3aa-4a11-affa-bba465cf2e90 req-3ebfefda-743a-44a4-9ba5-2d7093cf0bb0 tempest-SecurityGroupsTestJSON-1621209229 tempest-SecurityGroupsTestJSON-1621209229-project-member] Enqueued Resource ID: b99e414b-ff9c-4d19-b3c8-32ab58288d75 with Priority: HIGHEST for action security_group_rules [ 864.139347] env[69188]: INFO networking_nsxv3.common.synchronization [req-84532e18-e3aa-4a11-affa-bba465cf2e90 req-3ebfefda-743a-44a4-9ba5-2d7093cf0bb0 tempest-SecurityGroupsTestJSON-1621209229 tempest-SecurityGroupsTestJSON-1621209229-project-member] Enqueued Resource ID: b99e414b-ff9c-4d19-b3c8-32ab58288d75 with Priority: HIGHEST for action security_group_members [ 864.139600] env[69188]: INFO networking_nsxv3.common.synchronization [req-84532e18-e3aa-4a11-affa-bba465cf2e90 req-3ebfefda-743a-44a4-9ba5-2d7093cf0bb0 tempest-SecurityGroupsTestJSON-1621209229 tempest-SecurityGroupsTestJSON-1621209229-project-member] Enqueued Resource ID: e275bda6-f504-45ea-9805-84ac49a67aa7 with Priority: HIGHEST for action security_group_rules [ 864.139709] env[69188]: INFO networking_nsxv3.common.synchronization [req-84532e18-e3aa-4a11-affa-bba465cf2e90 req-3ebfefda-743a-44a4-9ba5-2d7093cf0bb0 tempest-SecurityGroupsTestJSON-1621209229 tempest-SecurityGroupsTestJSON-1621209229-project-member] Enqueued Resource ID: e275bda6-f504-45ea-9805-84ac49a67aa7 with Priority: HIGHEST for action security_group_members [ 864.140608] env[69188]: INFO networking_nsxv3.common.synchronization [req-84532e18-e3aa-4a11-affa-bba465cf2e90 req-3ebfefda-743a-44a4-9ba5-2d7093cf0bb0 tempest-SecurityGroupsTestJSON-1621209229 tempest-SecurityGroupsTestJSON-1621209229-project-member] Enqueued Resource ID: 91083377-9e3a-442b-947a-8b5ac6ea05d1 with Priority: HIGHEST for action port [ 864.140608] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 166e7c17-8917-425e-9cd8-0580f8aa3e74 with Priority: HIGHEST for action security_group_rules [ 864.140608] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b99e414b-ff9c-4d19-b3c8-32ab58288d75 with Priority: HIGHEST for action security_group_rules [ 864.140976] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e275bda6-f504-45ea-9805-84ac49a67aa7 with Priority: HIGHEST for action security_group_members [ 864.141042] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 91083377-9e3a-442b-947a-8b5ac6ea05d1 with Priority: HIGHEST for action port [ 864.141491] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e275bda6-f504-45ea-9805-84ac49a67aa7 with Priority: HIGHEST for action security_group_rules [ 864.141491] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 166e7c17-8917-425e-9cd8-0580f8aa3e74 with Priority: HIGHEST for action security_group_members [ 864.141491] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b99e414b-ff9c-4d19-b3c8-32ab58288d75 with Priority: HIGHEST for action security_group_members [ 864.141665] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-166e7c17-8917-425e-9cd8-0580f8aa3e74 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.141753] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-166e7c17-8917-425e-9cd8-0580f8aa3e74" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.141753] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-166e7c17-8917-425e-9cd8-0580f8aa3e74" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.142873] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-166e7c17-8917-425e-9cd8-0580f8aa3e74" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.142873] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('166e7c17-8917-425e-9cd8-0580f8aa3e74',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.144695] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b99e414b-ff9c-4d19-b3c8-32ab58288d75 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.144907] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b99e414b-ff9c-4d19-b3c8-32ab58288d75" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.145114] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-e275bda6-f504-45ea-9805-84ac49a67aa7 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.145231] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e275bda6-f504-45ea-9805-84ac49a67aa7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.145471] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-91083377-9e3a-442b-947a-8b5ac6ea05d1 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.145672] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-91083377-9e3a-442b-947a-8b5ac6ea05d1" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.145737] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-91083377-9e3a-442b-947a-8b5ac6ea05d1" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.145966] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-91083377-9e3a-442b-947a-8b5ac6ea05d1" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.146075] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('91083377-9e3a-442b-947a-8b5ac6ea05d1',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.147440] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e275bda6-f504-45ea-9805-84ac49a67aa7 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.147551] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e275bda6-f504-45ea-9805-84ac49a67aa7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.147729] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-166e7c17-8917-425e-9cd8-0580f8aa3e74 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.147813] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-166e7c17-8917-425e-9cd8-0580f8aa3e74" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.148150] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-b99e414b-ff9c-4d19-b3c8-32ab58288d75 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.148150] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b99e414b-ff9c-4d19-b3c8-32ab58288d75" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.238942] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 143fbb10-efe2-4f17-a012-d41cc9b595b6 in Status: SUCCESS [ 864.239270] env[69188]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 143fbb10-efe2-4f17-a012-d41cc9b595b6 deletion is rescheduled due to dependency. [ 864.239397] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-143fbb10-efe2-4f17-a012-d41cc9b595b6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.269726] env[69188]: INFO networking_nsxv3.common.synchronization [req-c324a48f-5020-4393-a59c-4dbd044187bb req-e81c07d5-2a8a-4dad-ae8c-79c94a39a41a tempest-ServersTestJSON-1495057482 tempest-ServersTestJSON-1495057482-project-member] Enqueued Resource ID: 9f2518e8-b195-4520-b262-caa765ab7e27 with Priority: HIGHEST for action security_group_members [ 864.273017] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f2518e8-b195-4520-b262-caa765ab7e27 with Priority: HIGHEST for action security_group_members [ 864.273017] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-9f2518e8-b195-4520-b262-caa765ab7e27 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.273017] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9f2518e8-b195-4520-b262-caa765ab7e27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.273017] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9f2518e8-b195-4520-b262-caa765ab7e27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.273017] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9f2518e8-b195-4520-b262-caa765ab7e27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.273017] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.273017] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.273017] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.273017] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.273017] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.273017] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9f2518e8-b195-4520-b262-caa765ab7e27',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.316390] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7f98bc00-dbd3-411c-a67a-14369145489a',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.318181] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-7f98bc00-dbd3-411c-a67a-14369145489a taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.318181] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7f98bc00-dbd3-411c-a67a-14369145489a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.318391] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 03bef75e-6f14-45da-a1a6-a59b55c161e3 with status ACTIVE [ 864.318587] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.319497] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.319585] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.319824] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.319920] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.320115] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.320223] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.320286] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.320473] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.320583] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.320747] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.320876] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.320949] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.321114] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.321193] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.321418] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 03bef75e-6f14-45da-a1a6-a59b55c161e3 is going to be updated. [ 864.342767] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.342767] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.342767] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.342767] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.342767] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.342767] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-03bef75e-6f14-45da-a1a6-a59b55c161e3" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.442700] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b99e414b-ff9c-4d19-b3c8-32ab58288d75',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.442700] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e275bda6-f504-45ea-9805-84ac49a67aa7',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.544250] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('166e7c17-8917-425e-9cd8-0580f8aa3e74',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.645659] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-166e7c17-8917-425e-9cd8-0580f8aa3e74 taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.646197] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-166e7c17-8917-425e-9cd8-0580f8aa3e74" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.647579] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 91083377-9e3a-442b-947a-8b5ac6ea05d1 with status ACTIVE [ 864.647839] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.647987] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.648093] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.648324] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.648449] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.648675] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.649362] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.649489] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.649732] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.649885] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.650195] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.650373] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.650489] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.650723] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.650856] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.650962] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 91083377-9e3a-442b-947a-8b5ac6ea05d1 is going to be updated. [ 864.671601] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.671802] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.671839] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.672052] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.672244] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.672411] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-91083377-9e3a-442b-947a-8b5ac6ea05d1" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.774431] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9f2518e8-b195-4520-b262-caa765ab7e27',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.819368] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7f98bc00-dbd3-411c-a67a-14369145489a',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.945545] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.945711] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.945783] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.945997] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.946225] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.946342] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b99e414b-ff9c-4d19-b3c8-32ab58288d75 is going to be updated. [ 864.947689] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.947804] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.947872] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.948113] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.948221] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.948319] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e275bda6-f504-45ea-9805-84ac49a67aa7 is going to be created. [ 864.974198] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.974369] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.974465] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.974780] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.974780] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.977155] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.977305] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.977352] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.977523] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.977699] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.982922] env[69188]: INFO networking_nsxv3.common.synchronization [req-bf52d97a-0368-47ce-9f73-0082a2ce3108 req-68447607-49fa-4e77-bf9e-d1eb75318a56 tempest-ServerMetadataTestJSON-1543680343 tempest-ServerMetadataTestJSON-1543680343-project-member] Enqueued Resource ID: 53a4d3c3-01ca-4828-94d1-6fa305c27650 with Priority: HIGHEST for action security_group_members [ 864.983186] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 53a4d3c3-01ca-4828-94d1-6fa305c27650 with Priority: HIGHEST for action security_group_members [ 864.983744] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-53a4d3c3-01ca-4828-94d1-6fa305c27650 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.983873] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-53a4d3c3-01ca-4828-94d1-6fa305c27650" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.984177] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-53a4d3c3-01ca-4828-94d1-6fa305c27650" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.984177] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-53a4d3c3-01ca-4828-94d1-6fa305c27650" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.984314] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.984401] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.984490] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.984595] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.984671] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.984756] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('53a4d3c3-01ca-4828-94d1-6fa305c27650',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.986134] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e275bda6-f504-45ea-9805-84ac49a67aa7 in Status: UNINITIALIZED for 2s [ 864.987189] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b99e414b-ff9c-4d19-b3c8-32ab58288d75 in Status: IN_PROGRESS for 2s [ 865.051593] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('166e7c17-8917-425e-9cd8-0580f8aa3e74',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.276655] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9f2518e8-b195-4520-b262-caa765ab7e27',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.322042] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.322152] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.322222] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.322473] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.322593] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.322729] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7f98bc00-dbd3-411c-a67a-14369145489a is going to be created. [ 865.345908] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.346066] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.346135] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.346355] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.346508] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.356013] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7f98bc00-dbd3-411c-a67a-14369145489a in Status: UNINITIALIZED for 2s [ 865.489650] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.489815] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.489888] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.490140] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.490242] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.490459] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.490561] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.490623] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.490774] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.490854] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.490965] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 53a4d3c3-01ca-4828-94d1-6fa305c27650 is going to be updated. [ 865.514609] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.514774] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.514843] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.515063] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.515273] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.523627] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 53a4d3c3-01ca-4828-94d1-6fa305c27650 in Status: IN_PROGRESS for 2s [ 865.554094] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.554272] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.554309] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.554553] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.554635] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.554734] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 166e7c17-8917-425e-9cd8-0580f8aa3e74 is going to be created. [ 865.575858] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.576109] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.576354] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.576443] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.576627] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.584631] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 166e7c17-8917-425e-9cd8-0580f8aa3e74 in Status: UNINITIALIZED for 2s [ 865.779229] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.779389] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.779462] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.779690] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.779821] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.779868] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9f2518e8-b195-4520-b262-caa765ab7e27 is going to be updated. [ 865.808900] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.809058] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.809130] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.809379] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.809515] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.818285] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9f2518e8-b195-4520-b262-caa765ab7e27 in Status: IN_PROGRESS for 2s [ 866.998305] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e275bda6-f504-45ea-9805-84ac49a67aa7 in Status: SUCCESS [ 866.998610] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e275bda6-f504-45ea-9805-84ac49a67aa7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.999499] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b99e414b-ff9c-4d19-b3c8-32ab58288d75 in Status: SUCCESS [ 866.999671] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b99e414b-ff9c-4d19-b3c8-32ab58288d75" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.999825] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e275bda6-f504-45ea-9805-84ac49a67aa7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.000047] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e275bda6-f504-45ea-9805-84ac49a67aa7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.002083] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.002083] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.002211] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.002339] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.002426] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.002526] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e275bda6-f504-45ea-9805-84ac49a67aa7',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.003369] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b99e414b-ff9c-4d19-b3c8-32ab58288d75" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.003892] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b99e414b-ff9c-4d19-b3c8-32ab58288d75" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.003892] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.003892] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.003892] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.004070] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.004070] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.004138] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b99e414b-ff9c-4d19-b3c8-32ab58288d75',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.366344] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7f98bc00-dbd3-411c-a67a-14369145489a in Status: SUCCESS [ 867.366503] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7f98bc00-dbd3-411c-a67a-14369145489a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.366614] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7f98bc00-dbd3-411c-a67a-14369145489a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.366834] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7f98bc00-dbd3-411c-a67a-14369145489a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.367026] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.367148] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.367213] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.367364] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.367445] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.367530] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7f98bc00-dbd3-411c-a67a-14369145489a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.367619] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7f98bc00-dbd3-411c-a67a-14369145489a',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.505698] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e275bda6-f504-45ea-9805-84ac49a67aa7',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.506689] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b99e414b-ff9c-4d19-b3c8-32ab58288d75',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.532048] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 53a4d3c3-01ca-4828-94d1-6fa305c27650 in Status: SUCCESS [ 867.532048] env[69188]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 53a4d3c3-01ca-4828-94d1-6fa305c27650 deletion is rescheduled due to dependency. [ 867.532048] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-53a4d3c3-01ca-4828-94d1-6fa305c27650" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.592390] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 166e7c17-8917-425e-9cd8-0580f8aa3e74 in Status: SUCCESS [ 867.592668] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-166e7c17-8917-425e-9cd8-0580f8aa3e74" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.592857] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-166e7c17-8917-425e-9cd8-0580f8aa3e74" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.593157] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-166e7c17-8917-425e-9cd8-0580f8aa3e74" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.593354] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.593475] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.593547] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.593694] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.593776] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.593870] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('166e7c17-8917-425e-9cd8-0580f8aa3e74',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.832714] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9f2518e8-b195-4520-b262-caa765ab7e27 in Status: SUCCESS [ 867.832937] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9f2518e8-b195-4520-b262-caa765ab7e27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.870025] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-7f98bc00-dbd3-411c-a67a-14369145489a taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.870137] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7f98bc00-dbd3-411c-a67a-14369145489a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.870208] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7f98bc00-dbd3-411c-a67a-14369145489a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.870432] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7f98bc00-dbd3-411c-a67a-14369145489a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.870590] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.870690] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.870745] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.870892] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.870998] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.871068] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7f98bc00-dbd3-411c-a67a-14369145489a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.871210] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-7f98bc00-dbd3-411c-a67a-14369145489a taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.871300] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7f98bc00-dbd3-411c-a67a-14369145489a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.871362] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7f98bc00-dbd3-411c-a67a-14369145489a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.871496] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7f98bc00-dbd3-411c-a67a-14369145489a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.871628] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.871714] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.871773] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.871901] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.871971] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.872057] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7f98bc00-dbd3-411c-a67a-14369145489a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.872144] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7f98bc00-dbd3-411c-a67a-14369145489a',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.008658] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e275bda6-f504-45ea-9805-84ac49a67aa7',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.011211] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b99e414b-ff9c-4d19-b3c8-32ab58288d75',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.096766] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('166e7c17-8917-425e-9cd8-0580f8aa3e74',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.375426] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7f98bc00-dbd3-411c-a67a-14369145489a: rpc.has_security_group_logging(os_id): False [ 868.392023] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.392023] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.392023] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.392023] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.392023] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.392023] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.392023] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.392023] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.392023] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.392023] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.392023] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.392023] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.392023] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.392023] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.392023] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.393102] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.393331] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.393488] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.393715] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.393875] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.394041] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7f98bc00-dbd3-411c-a67a-14369145489a is going to be created. [ 868.478334] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.478334] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.478334] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.478334] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.478334] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.492323] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7f98bc00-dbd3-411c-a67a-14369145489a in Status: IN_PROGRESS for 2s [ 868.511075] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.511075] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.511204] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.511724] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.511724] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.511724] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e275bda6-f504-45ea-9805-84ac49a67aa7 is going to be updated. [ 868.513137] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.513979] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.513979] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.513979] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.513979] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.513979] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b99e414b-ff9c-4d19-b3c8-32ab58288d75 is going to be updated. [ 868.554372] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.554565] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.554628] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.554866] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.555185] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.562233] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.562461] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.562461] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.562635] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.562777] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.567025] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b99e414b-ff9c-4d19-b3c8-32ab58288d75 in Status: IN_PROGRESS for 2s [ 868.569692] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e275bda6-f504-45ea-9805-84ac49a67aa7 in Status: IN_PROGRESS for 2s [ 868.598623] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('166e7c17-8917-425e-9cd8-0580f8aa3e74',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.101405] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.101725] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.101725] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.101831] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.101930] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.102046] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 166e7c17-8917-425e-9cd8-0580f8aa3e74 is going to be updated. [ 869.129933] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.130106] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.130163] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.130387] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.130549] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.140190] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 166e7c17-8917-425e-9cd8-0580f8aa3e74 in Status: IN_PROGRESS for 2s [ 869.983775] env[69188]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 869.984378] env[69188]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=13 [ 870.506569] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7f98bc00-dbd3-411c-a67a-14369145489a in Status: SUCCESS [ 870.506569] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7f98bc00-dbd3-411c-a67a-14369145489a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.581077] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e275bda6-f504-45ea-9805-84ac49a67aa7 in Status: SUCCESS [ 870.581077] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e275bda6-f504-45ea-9805-84ac49a67aa7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.581296] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e275bda6-f504-45ea-9805-84ac49a67aa7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.581330] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e275bda6-f504-45ea-9805-84ac49a67aa7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.581529] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.581648] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.581713] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.581865] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.581945] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.582040] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e275bda6-f504-45ea-9805-84ac49a67aa7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.582163] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e275bda6-f504-45ea-9805-84ac49a67aa7',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.583879] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b99e414b-ff9c-4d19-b3c8-32ab58288d75 in Status: SUCCESS [ 870.583980] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b99e414b-ff9c-4d19-b3c8-32ab58288d75" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.584084] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e275bda6-f504-45ea-9805-84ac49a67aa7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.584267] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e275bda6-f504-45ea-9805-84ac49a67aa7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.584443] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.584550] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.584615] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.584757] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.584835] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.584932] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e275bda6-f504-45ea-9805-84ac49a67aa7',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.585884] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b99e414b-ff9c-4d19-b3c8-32ab58288d75" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.585884] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b99e414b-ff9c-4d19-b3c8-32ab58288d75" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.586054] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.586174] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.586253] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.586401] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.586479] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.586561] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b99e414b-ff9c-4d19-b3c8-32ab58288d75" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.586652] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b99e414b-ff9c-4d19-b3c8-32ab58288d75',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.587728] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b99e414b-ff9c-4d19-b3c8-32ab58288d75" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.587820] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b99e414b-ff9c-4d19-b3c8-32ab58288d75" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.587944] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.588059] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.588142] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.588293] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.588372] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.588459] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b99e414b-ff9c-4d19-b3c8-32ab58288d75',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.943504] env[69188]: INFO networking_nsxv3.common.synchronization [req-28b3d53b-cef8-4533-814d-9560019327a2 req-ab7eee34-da38-4701-ad99-885c6c40e53d tempest-MultipleCreateTestJSON-27366217 tempest-MultipleCreateTestJSON-27366217-project-member] Enqueued Resource ID: 7f98bc00-dbd3-411c-a67a-14369145489a with Priority: HIGHEST for action security_group_members [ 870.944140] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f98bc00-dbd3-411c-a67a-14369145489a with Priority: HIGHEST for action security_group_members [ 870.944356] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-7f98bc00-dbd3-411c-a67a-14369145489a taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.944475] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7f98bc00-dbd3-411c-a67a-14369145489a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.944537] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7f98bc00-dbd3-411c-a67a-14369145489a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.944742] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7f98bc00-dbd3-411c-a67a-14369145489a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.944889] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.945040] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.945040] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.945252] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.945298] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.945355] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7f98bc00-dbd3-411c-a67a-14369145489a',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.091148] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e275bda6-f504-45ea-9805-84ac49a67aa7',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.091148] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e275bda6-f504-45ea-9805-84ac49a67aa7',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.091148] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-b99e414b-ff9c-4d19-b3c8-32ab58288d75 taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.091148] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b99e414b-ff9c-4d19-b3c8-32ab58288d75" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.095728] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b99e414b-ff9c-4d19-b3c8-32ab58288d75',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.150064] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 166e7c17-8917-425e-9cd8-0580f8aa3e74 in Status: SUCCESS [ 871.150321] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-166e7c17-8917-425e-9cd8-0580f8aa3e74" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.150556] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-166e7c17-8917-425e-9cd8-0580f8aa3e74" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.150788] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-166e7c17-8917-425e-9cd8-0580f8aa3e74" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.151009] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.152245] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.152361] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.152533] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.152621] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.152730] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-166e7c17-8917-425e-9cd8-0580f8aa3e74" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.152976] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('166e7c17-8917-425e-9cd8-0580f8aa3e74',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.260588] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock network-434 taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.260790] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "network-434" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.262630] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "network-434" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.262630] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "network-434" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.262630] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.262630] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.262630] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.262630] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.262630] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.262630] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 871.262630] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] NeedRegenerationException {{(pid=69188) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 871.262630] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] no value, waiting for create lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 871.263066] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] value creation lock acquired {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 871.263066] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 871.263066] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Calling creation function for not-yet-present value {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 871.263066] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 871.283163] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 871.283300] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69188) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 871.283403] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Released creation lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 871.283571] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "network-434" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.283880] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock port-df44d706-f63d-40e7-baea-b03b0bcd4d91 taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.284070] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "port-df44d706-f63d-40e7-baea-b03b0bcd4d91" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.284294] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "port-df44d706-f63d-40e7-baea-b03b0bcd4d91" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.284645] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "port-df44d706-f63d-40e7-baea-b03b0bcd4d91" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.284757] env[69188]: DEBUG networking_nsxv3.api.rpc [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('df44d706-f63d-40e7-baea-b03b0bcd4d91',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.446905] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7f98bc00-dbd3-411c-a67a-14369145489a',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.591844] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e275bda6-f504-45ea-9805-84ac49a67aa7: rpc.has_security_group_logging(os_id): False [ 871.593061] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e275bda6-f504-45ea-9805-84ac49a67aa7',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.600083] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b99e414b-ff9c-4d19-b3c8-32ab58288d75',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.609836] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.609988] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.610126] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.610362] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.610494] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.610809] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.610898] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.610980] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.611202] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.611286] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.611375] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e275bda6-f504-45ea-9805-84ac49a67aa7 is going to be created. [ 871.656044] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('166e7c17-8917-425e-9cd8-0580f8aa3e74',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.661444] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.662342] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.662342] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.662342] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.662342] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.671971] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e275bda6-f504-45ea-9805-84ac49a67aa7 in Status: IN_PROGRESS for 2s [ 871.790859] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.791189] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.791353] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.791646] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.791833] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.792057] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Segment Port df44d706-f63d-40e7-baea-b03b0bcd4d91 not found, creating... [ 871.792347] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.792515] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.792632] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.792860] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.793012] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.793312] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.793468] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.793588] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.793800] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.793930] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.794090] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Resource: SegmentPort with ID: df44d706-f63d-40e7-baea-b03b0bcd4d91 is going to be created. [ 871.811522] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.811688] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.811815] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.812092] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.812352] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.812557] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "port-df44d706-f63d-40e7-baea-b03b0bcd4d91" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.950650] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7f98bc00-dbd3-411c-a67a-14369145489a',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.096403] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.096403] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.096403] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.096403] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.096403] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.096403] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e275bda6-f504-45ea-9805-84ac49a67aa7 is going to be updated. [ 872.102442] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.102561] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.102612] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.102796] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.102878] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.102967] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b99e414b-ff9c-4d19-b3c8-32ab58288d75 is going to be updated. [ 872.122866] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.123015] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.123090] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.123357] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.123510] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.125149] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.125269] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.125336] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.125499] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.125618] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.134237] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b99e414b-ff9c-4d19-b3c8-32ab58288d75 in Status: IN_PROGRESS for 2s [ 872.134837] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e275bda6-f504-45ea-9805-84ac49a67aa7 in Status: IN_PROGRESS for 2s [ 872.158756] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 166e7c17-8917-425e-9cd8-0580f8aa3e74: rpc.has_security_group_logging(os_id): False [ 872.175195] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.175641] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.175641] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.175641] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.175755] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.176055] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.176055] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.176145] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.176282] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.176315] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.176385] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 166e7c17-8917-425e-9cd8-0580f8aa3e74 is going to be created. [ 872.227044] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.227195] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.227270] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.227481] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.227652] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.245235] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 166e7c17-8917-425e-9cd8-0580f8aa3e74 in Status: IN_PROGRESS for 2s [ 872.452874] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.453056] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.453132] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.453352] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.453446] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.453542] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7f98bc00-dbd3-411c-a67a-14369145489a is going to be updated. [ 872.479914] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.479914] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.479914] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.479914] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.479914] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.492906] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7f98bc00-dbd3-411c-a67a-14369145489a in Status: IN_PROGRESS for 2s [ 872.529177] env[69188]: INFO networking_nsxv3.common.synchronization [req-28b3d53b-cef8-4533-814d-9560019327a2 req-4bf0e408-7884-4fec-aaf2-0b98df2af718 service nova] Enqueued Resource ID: 7f98bc00-dbd3-411c-a67a-14369145489a with Priority: HIGHEST for action security_group_rules [ 872.529393] env[69188]: INFO networking_nsxv3.common.synchronization [req-28b3d53b-cef8-4533-814d-9560019327a2 req-4bf0e408-7884-4fec-aaf2-0b98df2af718 service nova] Enqueued Resource ID: 7f98bc00-dbd3-411c-a67a-14369145489a with Priority: HIGHEST for action security_group_members [ 872.529534] env[69188]: INFO networking_nsxv3.common.synchronization [req-28b3d53b-cef8-4533-814d-9560019327a2 req-4bf0e408-7884-4fec-aaf2-0b98df2af718 service nova] Enqueued Resource ID: df44d706-f63d-40e7-baea-b03b0bcd4d91 with Priority: HIGHEST for action port [ 872.529763] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f98bc00-dbd3-411c-a67a-14369145489a with Priority: HIGHEST for action security_group_rules [ 872.529887] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f98bc00-dbd3-411c-a67a-14369145489a with Priority: HIGHEST for action security_group_members [ 872.529982] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df44d706-f63d-40e7-baea-b03b0bcd4d91 with Priority: HIGHEST for action port [ 872.530595] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7f98bc00-dbd3-411c-a67a-14369145489a taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.530661] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7f98bc00-dbd3-411c-a67a-14369145489a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.530705] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7f98bc00-dbd3-411c-a67a-14369145489a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.530903] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7f98bc00-dbd3-411c-a67a-14369145489a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.530984] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7f98bc00-dbd3-411c-a67a-14369145489a',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.536208] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-7f98bc00-dbd3-411c-a67a-14369145489a taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.536312] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7f98bc00-dbd3-411c-a67a-14369145489a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.536509] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-df44d706-f63d-40e7-baea-b03b0bcd4d91 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.536610] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-df44d706-f63d-40e7-baea-b03b0bcd4d91" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.536959] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-df44d706-f63d-40e7-baea-b03b0bcd4d91" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.536959] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-df44d706-f63d-40e7-baea-b03b0bcd4d91" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.536959] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('df44d706-f63d-40e7-baea-b03b0bcd4d91',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 873.038561] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-7f98bc00-dbd3-411c-a67a-14369145489a taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.038876] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7f98bc00-dbd3-411c-a67a-14369145489a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.038923] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port df44d706-f63d-40e7-baea-b03b0bcd4d91 with status ACTIVE [ 873.039086] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.039227] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.039335] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.039574] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.039668] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.039843] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.039942] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.040015] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.040171] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.040266] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.040460] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.040552] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.040633] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.040781] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.040866] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.040932] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: df44d706-f63d-40e7-baea-b03b0bcd4d91 is going to be updated. [ 873.061606] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.061606] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.061606] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.061808] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.061910] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.062081] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-df44d706-f63d-40e7-baea-b03b0bcd4d91" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.455787] env[69188]: INFO networking_nsxv3.common.synchronization [req-4bf99d26-c515-4d6c-9d58-cb787c4e6a27 req-54161fb5-7552-42fb-992f-b750f3873742 tempest-DeleteServersTestJSON-857706435 tempest-DeleteServersTestJSON-857706435-project-member] Enqueued Resource ID: 397559b2-3c5a-424d-b09d-43a25d2abba6 with Priority: HIGHEST for action security_group_members [ 873.456473] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 397559b2-3c5a-424d-b09d-43a25d2abba6 with Priority: HIGHEST for action security_group_members [ 873.456808] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-397559b2-3c5a-424d-b09d-43a25d2abba6 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.456927] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-397559b2-3c5a-424d-b09d-43a25d2abba6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.457011] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-397559b2-3c5a-424d-b09d-43a25d2abba6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.457290] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-397559b2-3c5a-424d-b09d-43a25d2abba6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.457480] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.457586] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.457639] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.457796] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.457879] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.457970] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('397559b2-3c5a-424d-b09d-43a25d2abba6',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 873.684151] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e275bda6-f504-45ea-9805-84ac49a67aa7 in Status: SUCCESS [ 873.684151] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e275bda6-f504-45ea-9805-84ac49a67aa7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.684151] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e275bda6-f504-45ea-9805-84ac49a67aa7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.684151] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e275bda6-f504-45ea-9805-84ac49a67aa7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.684151] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e275bda6-f504-45ea-9805-84ac49a67aa7',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 873.961126] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.961393] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.961393] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.961566] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.961651] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.961845] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.961931] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.961988] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.962171] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.962223] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.962313] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 397559b2-3c5a-424d-b09d-43a25d2abba6 is going to be deleted. [ 873.989851] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.989851] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.989851] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.989851] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.989851] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.989851] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-397559b2-3c5a-424d-b09d-43a25d2abba6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.145383] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b99e414b-ff9c-4d19-b3c8-32ab58288d75 in Status: SUCCESS [ 874.146154] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b99e414b-ff9c-4d19-b3c8-32ab58288d75" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.146360] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b99e414b-ff9c-4d19-b3c8-32ab58288d75" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.146684] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b99e414b-ff9c-4d19-b3c8-32ab58288d75" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.146922] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.148089] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.148177] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.148509] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.149735] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.149735] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b99e414b-ff9c-4d19-b3c8-32ab58288d75',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 874.152985] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e275bda6-f504-45ea-9805-84ac49a67aa7 in Status: SUCCESS [ 874.152985] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e275bda6-f504-45ea-9805-84ac49a67aa7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.152985] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e275bda6-f504-45ea-9805-84ac49a67aa7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.152985] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e275bda6-f504-45ea-9805-84ac49a67aa7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.152985] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.152985] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.152985] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.152985] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.153233] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.153233] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e275bda6-f504-45ea-9805-84ac49a67aa7',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 874.185991] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-e275bda6-f504-45ea-9805-84ac49a67aa7 taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.186122] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e275bda6-f504-45ea-9805-84ac49a67aa7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.259627] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 166e7c17-8917-425e-9cd8-0580f8aa3e74 in Status: SUCCESS [ 874.260167] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-166e7c17-8917-425e-9cd8-0580f8aa3e74" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.279713] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock network-449 taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.279713] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "network-449" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.279713] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "network-449" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.279713] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "network-449" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.280103] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.280103] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.280228] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.280385] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.280557] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.280777] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 874.280888] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] NeedRegenerationException {{(pid=69188) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 874.280990] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] no value, waiting for create lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 874.281121] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] value creation lock acquired {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 874.281233] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 874.281335] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Calling creation function for not-yet-present value {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 874.281471] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 874.298313] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 874.298553] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=69188) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 874.298708] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Released creation lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 874.298889] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "network-449" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.299219] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock port-d4a524ac-6be2-4246-8f27-09159d533e92 taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.299396] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "port-d4a524ac-6be2-4246-8f27-09159d533e92" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.299519] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "port-d4a524ac-6be2-4246-8f27-09159d533e92" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.299918] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "port-d4a524ac-6be2-4246-8f27-09159d533e92" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.299970] env[69188]: DEBUG networking_nsxv3.api.rpc [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d4a524ac-6be2-4246-8f27-09159d533e92',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 874.499354] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7f98bc00-dbd3-411c-a67a-14369145489a in Status: SUCCESS [ 874.499589] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7f98bc00-dbd3-411c-a67a-14369145489a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.499762] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7f98bc00-dbd3-411c-a67a-14369145489a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.499988] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7f98bc00-dbd3-411c-a67a-14369145489a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.500194] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.500314] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.500380] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.500535] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.500620] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.500717] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7f98bc00-dbd3-411c-a67a-14369145489a',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 874.656529] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b99e414b-ff9c-4d19-b3c8-32ab58288d75',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 874.658195] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e275bda6-f504-45ea-9805-84ac49a67aa7',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 874.803278] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.803493] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.803628] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.803950] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.804127] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.804290] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Segment Port d4a524ac-6be2-4246-8f27-09159d533e92 not found, creating... [ 874.804556] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.804745] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.804833] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.805066] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.805250] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.805602] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.805778] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.805900] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.806174] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.806322] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.806465] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Resource: SegmentPort with ID: d4a524ac-6be2-4246-8f27-09159d533e92 is going to be created. [ 874.828061] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.828061] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.828061] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.828061] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.828332] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.828420] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "port-d4a524ac-6be2-4246-8f27-09159d533e92" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.002558] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7f98bc00-dbd3-411c-a67a-14369145489a',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.161877] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b99e414b-ff9c-4d19-b3c8-32ab58288d75',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.163218] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e275bda6-f504-45ea-9805-84ac49a67aa7',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.505308] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7f98bc00-dbd3-411c-a67a-14369145489a',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.622258] env[69188]: INFO networking_nsxv3.common.synchronization [req-4bf99d26-c515-4d6c-9d58-cb787c4e6a27 req-00b2ffcd-4dad-49e6-9faf-c0acafa158d5 service nova] Enqueued Resource ID: 397559b2-3c5a-424d-b09d-43a25d2abba6 with Priority: HIGHEST for action security_group_rules [ 875.622480] env[69188]: INFO networking_nsxv3.common.synchronization [req-4bf99d26-c515-4d6c-9d58-cb787c4e6a27 req-00b2ffcd-4dad-49e6-9faf-c0acafa158d5 service nova] Enqueued Resource ID: 397559b2-3c5a-424d-b09d-43a25d2abba6 with Priority: HIGHEST for action security_group_members [ 875.622623] env[69188]: INFO networking_nsxv3.common.synchronization [req-4bf99d26-c515-4d6c-9d58-cb787c4e6a27 req-00b2ffcd-4dad-49e6-9faf-c0acafa158d5 service nova] Enqueued Resource ID: d4a524ac-6be2-4246-8f27-09159d533e92 with Priority: HIGHEST for action port [ 875.622852] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 397559b2-3c5a-424d-b09d-43a25d2abba6 with Priority: HIGHEST for action security_group_rules [ 875.622976] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 397559b2-3c5a-424d-b09d-43a25d2abba6 with Priority: HIGHEST for action security_group_members [ 875.623086] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d4a524ac-6be2-4246-8f27-09159d533e92 with Priority: HIGHEST for action port [ 875.623623] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-397559b2-3c5a-424d-b09d-43a25d2abba6 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.623745] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-397559b2-3c5a-424d-b09d-43a25d2abba6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.623810] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-397559b2-3c5a-424d-b09d-43a25d2abba6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.624028] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-397559b2-3c5a-424d-b09d-43a25d2abba6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.625702] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('397559b2-3c5a-424d-b09d-43a25d2abba6',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.625996] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-397559b2-3c5a-424d-b09d-43a25d2abba6 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.626152] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-397559b2-3c5a-424d-b09d-43a25d2abba6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.626241] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-397559b2-3c5a-424d-b09d-43a25d2abba6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.626431] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-397559b2-3c5a-424d-b09d-43a25d2abba6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.626585] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.626945] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.626945] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.626945] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.626945] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.627164] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('397559b2-3c5a-424d-b09d-43a25d2abba6',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.628038] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-d4a524ac-6be2-4246-8f27-09159d533e92 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.628191] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d4a524ac-6be2-4246-8f27-09159d533e92" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.628223] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d4a524ac-6be2-4246-8f27-09159d533e92" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.628380] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d4a524ac-6be2-4246-8f27-09159d533e92" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.628457] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d4a524ac-6be2-4246-8f27-09159d533e92',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.665136] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.665136] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.665136] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.665136] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.665136] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.665136] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b99e414b-ff9c-4d19-b3c8-32ab58288d75 is going to be updated. [ 875.666160] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.666294] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.666363] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.666530] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.666675] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.666722] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e275bda6-f504-45ea-9805-84ac49a67aa7 is going to be updated. [ 875.710365] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.710605] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.710689] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.710907] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.711061] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.713227] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.713385] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.713459] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.713637] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.714309] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.724070] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b99e414b-ff9c-4d19-b3c8-32ab58288d75 in Status: IN_PROGRESS for 2s [ 875.724671] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e275bda6-f504-45ea-9805-84ac49a67aa7 in Status: IN_PROGRESS for 2s [ 876.006929] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.007201] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.007265] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.010537] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.010537] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.010537] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7f98bc00-dbd3-411c-a67a-14369145489a is going to be updated. [ 876.037152] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.037323] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.037384] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.037595] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.037740] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.046521] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7f98bc00-dbd3-411c-a67a-14369145489a in Status: IN_PROGRESS for 2s [ 876.133391] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('397559b2-3c5a-424d-b09d-43a25d2abba6',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.133592] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-397559b2-3c5a-424d-b09d-43a25d2abba6 taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.133592] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-397559b2-3c5a-424d-b09d-43a25d2abba6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.133767] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d4a524ac-6be2-4246-8f27-09159d533e92 with status ACTIVE [ 876.133897] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.134019] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.134085] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.134468] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.134605] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.134819] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.134951] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.135030] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.135241] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.135346] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.135562] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.135676] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.135745] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.136176] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.136295] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.136391] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d4a524ac-6be2-4246-8f27-09159d533e92 is going to be updated. [ 876.143531] env[69188]: INFO networking_nsxv3.common.synchronization [req-5f05188d-20ae-48a7-8c6c-84f7b721fa5d req-e5ac9e5e-eab5-4ec7-9117-21e5870560a4 tempest-ServersAdminTestJSON-1988649207 tempest-ServersAdminTestJSON-1988649207-project-member] Enqueued Resource ID: 5e76d42e-7ec6-4a5e-aa9c-c5a285d62318 with Priority: HIGHEST for action security_group_members [ 876.143531] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e76d42e-7ec6-4a5e-aa9c-c5a285d62318 with Priority: HIGHEST for action security_group_members [ 876.143531] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e76d42e-7ec6-4a5e-aa9c-c5a285d62318 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.143531] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e76d42e-7ec6-4a5e-aa9c-c5a285d62318" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.143531] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e76d42e-7ec6-4a5e-aa9c-c5a285d62318" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.143792] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e76d42e-7ec6-4a5e-aa9c-c5a285d62318" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.143792] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.143857] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.144494] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.144494] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.144494] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.144494] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5e76d42e-7ec6-4a5e-aa9c-c5a285d62318',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.158965] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.159110] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.159229] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.159412] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.159554] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.159698] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d4a524ac-6be2-4246-8f27-09159d533e92" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.443844] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock network-932 taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.444165] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "network-932" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.444336] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "network-932" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.444711] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "network-932" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.445104] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.445348] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.445537] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.445850] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.446087] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.446393] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 876.446568] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] NeedRegenerationException {{(pid=69188) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 876.446744] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] no value, waiting for create lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 876.446917] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] value creation lock acquired {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 876.447107] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 876.447286] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Calling creation function for not-yet-present value {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 876.447496] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 876.466304] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 876.466555] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69188) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 876.466712] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Released creation lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 876.466921] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "network-932" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.467310] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock port-f19d7682-67e2-40c4-8721-cfd5f8a4bec3 taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.467498] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "port-f19d7682-67e2-40c4-8721-cfd5f8a4bec3" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.467621] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "port-f19d7682-67e2-40c4-8721-cfd5f8a4bec3" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.467941] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "port-f19d7682-67e2-40c4-8721-cfd5f8a4bec3" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.468106] env[69188]: DEBUG networking_nsxv3.api.rpc [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f19d7682-67e2-40c4-8721-cfd5f8a4bec3',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.638369] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('397559b2-3c5a-424d-b09d-43a25d2abba6',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.648056] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5e76d42e-7ec6-4a5e-aa9c-c5a285d62318',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.973562] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.973765] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.973917] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.974267] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.974448] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.974724] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Segment Port f19d7682-67e2-40c4-8721-cfd5f8a4bec3 not found, creating... [ 876.974998] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.975191] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.975265] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.975523] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.976098] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.976098] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.976289] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.976358] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.976614] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.976758] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.976916] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Resource: SegmentPort with ID: f19d7682-67e2-40c4-8721-cfd5f8a4bec3 is going to be created. [ 876.996566] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.996791] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.998605] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.998605] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.998605] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.998605] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "port-f19d7682-67e2-40c4-8721-cfd5f8a4bec3" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.141449] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.141449] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.141681] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.141778] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.141887] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.141990] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 397559b2-3c5a-424d-b09d-43a25d2abba6 is going to be created. [ 877.150189] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5e76d42e-7ec6-4a5e-aa9c-c5a285d62318',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.171968] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.171968] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.171968] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.171968] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.172238] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.181375] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 397559b2-3c5a-424d-b09d-43a25d2abba6 in Status: UNINITIALIZED for 2s [ 877.653265] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.653677] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.653677] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.654543] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.654723] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.655460] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5e76d42e-7ec6-4a5e-aa9c-c5a285d62318 is going to be updated. [ 877.687958] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.688129] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.688258] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.688504] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.688620] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.696758] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5e76d42e-7ec6-4a5e-aa9c-c5a285d62318 in Status: IN_PROGRESS for 2s [ 877.737323] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e275bda6-f504-45ea-9805-84ac49a67aa7 in Status: SUCCESS [ 877.737602] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e275bda6-f504-45ea-9805-84ac49a67aa7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.737602] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e275bda6-f504-45ea-9805-84ac49a67aa7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.739529] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e275bda6-f504-45ea-9805-84ac49a67aa7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.739529] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.739529] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.739529] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.739529] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.739529] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.739529] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e275bda6-f504-45ea-9805-84ac49a67aa7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.739529] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e275bda6-f504-45ea-9805-84ac49a67aa7',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.740537] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b99e414b-ff9c-4d19-b3c8-32ab58288d75 in Status: SUCCESS [ 877.740688] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b99e414b-ff9c-4d19-b3c8-32ab58288d75" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.740835] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b99e414b-ff9c-4d19-b3c8-32ab58288d75" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.740990] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b99e414b-ff9c-4d19-b3c8-32ab58288d75" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.741168] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.741265] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.741342] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.741499] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.741574] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.741655] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b99e414b-ff9c-4d19-b3c8-32ab58288d75" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.741808] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-b99e414b-ff9c-4d19-b3c8-32ab58288d75 taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.741896] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b99e414b-ff9c-4d19-b3c8-32ab58288d75" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.741954] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b99e414b-ff9c-4d19-b3c8-32ab58288d75" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.744023] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b99e414b-ff9c-4d19-b3c8-32ab58288d75" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.744023] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.744023] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.744023] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.744023] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.744023] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.744023] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b99e414b-ff9c-4d19-b3c8-32ab58288d75" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.744023] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b99e414b-ff9c-4d19-b3c8-32ab58288d75',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.753619] env[69188]: INFO networking_nsxv3.common.synchronization [req-5f05188d-20ae-48a7-8c6c-84f7b721fa5d req-576fab40-9832-458c-83e3-895280d8e34f service nova] Enqueued Resource ID: 5e76d42e-7ec6-4a5e-aa9c-c5a285d62318 with Priority: HIGHEST for action security_group_rules [ 877.753839] env[69188]: INFO networking_nsxv3.common.synchronization [req-5f05188d-20ae-48a7-8c6c-84f7b721fa5d req-576fab40-9832-458c-83e3-895280d8e34f service nova] Enqueued Resource ID: 5e76d42e-7ec6-4a5e-aa9c-c5a285d62318 with Priority: HIGHEST for action security_group_members [ 877.753988] env[69188]: INFO networking_nsxv3.common.synchronization [req-5f05188d-20ae-48a7-8c6c-84f7b721fa5d req-576fab40-9832-458c-83e3-895280d8e34f service nova] Enqueued Resource ID: f19d7682-67e2-40c4-8721-cfd5f8a4bec3 with Priority: HIGHEST for action port [ 877.755084] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e76d42e-7ec6-4a5e-aa9c-c5a285d62318 with Priority: HIGHEST for action security_group_rules [ 877.755084] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e76d42e-7ec6-4a5e-aa9c-c5a285d62318 with Priority: HIGHEST for action security_group_members [ 877.755084] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f19d7682-67e2-40c4-8721-cfd5f8a4bec3 with Priority: HIGHEST for action port [ 877.755084] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5e76d42e-7ec6-4a5e-aa9c-c5a285d62318 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.755253] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5e76d42e-7ec6-4a5e-aa9c-c5a285d62318" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.755253] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5e76d42e-7ec6-4a5e-aa9c-c5a285d62318" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.755382] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5e76d42e-7ec6-4a5e-aa9c-c5a285d62318" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.755457] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5e76d42e-7ec6-4a5e-aa9c-c5a285d62318',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.756242] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e76d42e-7ec6-4a5e-aa9c-c5a285d62318 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.758303] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e76d42e-7ec6-4a5e-aa9c-c5a285d62318" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.758303] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-f19d7682-67e2-40c4-8721-cfd5f8a4bec3 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.758303] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f19d7682-67e2-40c4-8721-cfd5f8a4bec3" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.758303] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f19d7682-67e2-40c4-8721-cfd5f8a4bec3" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.758303] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f19d7682-67e2-40c4-8721-cfd5f8a4bec3" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.758303] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f19d7682-67e2-40c4-8721-cfd5f8a4bec3',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 878.056434] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7f98bc00-dbd3-411c-a67a-14369145489a in Status: SUCCESS [ 878.056658] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7f98bc00-dbd3-411c-a67a-14369145489a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.056869] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7f98bc00-dbd3-411c-a67a-14369145489a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.057181] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7f98bc00-dbd3-411c-a67a-14369145489a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.057324] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.057501] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.057501] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.057649] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.057729] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.057814] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7f98bc00-dbd3-411c-a67a-14369145489a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.057905] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7f98bc00-dbd3-411c-a67a-14369145489a',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 878.244462] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e275bda6-f504-45ea-9805-84ac49a67aa7',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 878.245766] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b99e414b-ff9c-4d19-b3c8-32ab58288d75: rpc.has_security_group_logging(os_id): False [ 878.259922] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e76d42e-7ec6-4a5e-aa9c-c5a285d62318 taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.260142] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e76d42e-7ec6-4a5e-aa9c-c5a285d62318" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.260407] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f19d7682-67e2-40c4-8721-cfd5f8a4bec3 with status ACTIVE [ 878.260668] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.260831] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.260932] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.261256] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.261418] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.261688] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.261839] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.261956] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.262189] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.262329] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.262622] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.262744] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.262844] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.263065] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.263186] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.263312] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f19d7682-67e2-40c4-8721-cfd5f8a4bec3 is going to be updated. [ 878.266441] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.266745] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.266745] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.268026] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.268026] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.268351] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.268351] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.268480] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.268538] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.268601] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.268794] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.268888] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.268945] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.269103] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.269332] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.269393] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.269480] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.269528] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.269643] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.269700] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.269786] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b99e414b-ff9c-4d19-b3c8-32ab58288d75 is going to be updated. [ 878.304028] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.304240] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.304322] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.304591] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.304780] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.304996] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f19d7682-67e2-40c4-8721-cfd5f8a4bec3" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.366989] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.367176] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.367229] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.367434] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.367580] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.389502] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b99e414b-ff9c-4d19-b3c8-32ab58288d75 in Status: IN_PROGRESS for 2s [ 878.560710] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-7f98bc00-dbd3-411c-a67a-14369145489a taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.560710] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7f98bc00-dbd3-411c-a67a-14369145489a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.560861] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7f98bc00-dbd3-411c-a67a-14369145489a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.561644] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7f98bc00-dbd3-411c-a67a-14369145489a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.561644] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.561644] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.561644] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.561644] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.561644] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.561644] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7f98bc00-dbd3-411c-a67a-14369145489a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.562046] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-7f98bc00-dbd3-411c-a67a-14369145489a taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.562046] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7f98bc00-dbd3-411c-a67a-14369145489a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.562046] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7f98bc00-dbd3-411c-a67a-14369145489a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.562046] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7f98bc00-dbd3-411c-a67a-14369145489a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.562271] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.562271] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.562358] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.562880] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.562880] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.562880] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7f98bc00-dbd3-411c-a67a-14369145489a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.562880] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7f98bc00-dbd3-411c-a67a-14369145489a',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 878.749304] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e275bda6-f504-45ea-9805-84ac49a67aa7: rpc.has_security_group_logging(os_id): False [ 878.770953] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.771265] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.771410] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.771769] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.772324] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.772324] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.772324] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.772461] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.772562] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.772626] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.772717] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e275bda6-f504-45ea-9805-84ac49a67aa7 is going to be updated. [ 878.828983] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.829645] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.829645] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.829645] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.829645] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.848972] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e275bda6-f504-45ea-9805-84ac49a67aa7 in Status: IN_PROGRESS for 2s [ 879.064814] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7f98bc00-dbd3-411c-a67a-14369145489a: rpc.has_security_group_logging(os_id): False [ 879.081867] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.083104] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.083104] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.083104] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.083104] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.083104] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.083104] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.083104] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.083104] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.083104] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.083460] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.083460] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.083460] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.083460] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.083576] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.083725] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.083815] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.084952] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.084952] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.084952] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.084952] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7f98bc00-dbd3-411c-a67a-14369145489a is going to be updated. [ 879.154479] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.154479] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.154479] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.154479] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.154479] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.167286] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7f98bc00-dbd3-411c-a67a-14369145489a in Status: IN_PROGRESS for 2s [ 879.190097] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 397559b2-3c5a-424d-b09d-43a25d2abba6 in Status: SUCCESS [ 879.191888] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-397559b2-3c5a-424d-b09d-43a25d2abba6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.191888] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-397559b2-3c5a-424d-b09d-43a25d2abba6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.191888] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-397559b2-3c5a-424d-b09d-43a25d2abba6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.191888] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.191888] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.191888] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.191888] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.191888] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.191888] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-397559b2-3c5a-424d-b09d-43a25d2abba6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.191888] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('397559b2-3c5a-424d-b09d-43a25d2abba6',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 879.695450] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-397559b2-3c5a-424d-b09d-43a25d2abba6 taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.695657] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-397559b2-3c5a-424d-b09d-43a25d2abba6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.695755] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-397559b2-3c5a-424d-b09d-43a25d2abba6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.696014] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-397559b2-3c5a-424d-b09d-43a25d2abba6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.696725] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.696864] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.696944] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.697146] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.697251] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.697370] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-397559b2-3c5a-424d-b09d-43a25d2abba6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.697563] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-397559b2-3c5a-424d-b09d-43a25d2abba6 taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.697683] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-397559b2-3c5a-424d-b09d-43a25d2abba6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.697779] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-397559b2-3c5a-424d-b09d-43a25d2abba6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.697941] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-397559b2-3c5a-424d-b09d-43a25d2abba6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.698119] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.698237] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.698319] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.698478] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.698559] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.698655] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-397559b2-3c5a-424d-b09d-43a25d2abba6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.698769] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('397559b2-3c5a-424d-b09d-43a25d2abba6',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 879.709139] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5e76d42e-7ec6-4a5e-aa9c-c5a285d62318 in Status: SUCCESS [ 879.709701] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e76d42e-7ec6-4a5e-aa9c-c5a285d62318" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.710320] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e76d42e-7ec6-4a5e-aa9c-c5a285d62318" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.710542] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e76d42e-7ec6-4a5e-aa9c-c5a285d62318" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.710784] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.710868] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.710906] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.711098] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.711184] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.711296] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5e76d42e-7ec6-4a5e-aa9c-c5a285d62318',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 880.201731] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 397559b2-3c5a-424d-b09d-43a25d2abba6: rpc.has_security_group_logging(os_id): False [ 880.214158] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5e76d42e-7ec6-4a5e-aa9c-c5a285d62318',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 880.219473] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.219615] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.219737] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.219895] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.219988] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.220203] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.220348] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.220348] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.220491] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.220580] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.220761] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.220837] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.220921] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.221051] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.221126] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.221458] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.221458] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.221458] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.221673] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.221673] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.221725] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 397559b2-3c5a-424d-b09d-43a25d2abba6 is going to be created. [ 880.276849] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.277844] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.277844] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.277844] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.277844] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.294886] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 397559b2-3c5a-424d-b09d-43a25d2abba6 in Status: IN_PROGRESS for 2s [ 880.411174] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b99e414b-ff9c-4d19-b3c8-32ab58288d75 in Status: SUCCESS [ 880.411174] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b99e414b-ff9c-4d19-b3c8-32ab58288d75" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.411264] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b99e414b-ff9c-4d19-b3c8-32ab58288d75" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.411410] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b99e414b-ff9c-4d19-b3c8-32ab58288d75" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.411500] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b99e414b-ff9c-4d19-b3c8-32ab58288d75',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 880.716157] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5e76d42e-7ec6-4a5e-aa9c-c5a285d62318',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 880.865461] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e275bda6-f504-45ea-9805-84ac49a67aa7 in Status: SUCCESS [ 880.865712] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e275bda6-f504-45ea-9805-84ac49a67aa7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.916397] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-b99e414b-ff9c-4d19-b3c8-32ab58288d75 taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.916397] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b99e414b-ff9c-4d19-b3c8-32ab58288d75" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.916397] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b99e414b-ff9c-4d19-b3c8-32ab58288d75" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.916397] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b99e414b-ff9c-4d19-b3c8-32ab58288d75" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.916397] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.916397] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.916397] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.916397] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.916397] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.916776] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b99e414b-ff9c-4d19-b3c8-32ab58288d75" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.916776] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b99e414b-ff9c-4d19-b3c8-32ab58288d75',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.186624] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7f98bc00-dbd3-411c-a67a-14369145489a in Status: SUCCESS [ 881.186904] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7f98bc00-dbd3-411c-a67a-14369145489a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.219275] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.219908] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.219908] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.220039] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.220214] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.220265] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5e76d42e-7ec6-4a5e-aa9c-c5a285d62318 is going to be updated. [ 881.246769] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.246915] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.246986] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.247210] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.247419] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.258983] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5e76d42e-7ec6-4a5e-aa9c-c5a285d62318 in Status: IN_PROGRESS for 2s [ 881.419077] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-b99e414b-ff9c-4d19-b3c8-32ab58288d75 taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.419223] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b99e414b-ff9c-4d19-b3c8-32ab58288d75" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.419223] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b99e414b-ff9c-4d19-b3c8-32ab58288d75" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.419760] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b99e414b-ff9c-4d19-b3c8-32ab58288d75" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.419760] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.419760] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.419912] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.420024] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.420143] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.420704] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b99e414b-ff9c-4d19-b3c8-32ab58288d75" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.420704] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-b99e414b-ff9c-4d19-b3c8-32ab58288d75 taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.420704] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b99e414b-ff9c-4d19-b3c8-32ab58288d75" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.420704] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b99e414b-ff9c-4d19-b3c8-32ab58288d75" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.420902] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b99e414b-ff9c-4d19-b3c8-32ab58288d75" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.420934] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.421020] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.421080] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.421220] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.421301] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.421384] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b99e414b-ff9c-4d19-b3c8-32ab58288d75" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.421476] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b99e414b-ff9c-4d19-b3c8-32ab58288d75',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.924218] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b99e414b-ff9c-4d19-b3c8-32ab58288d75: rpc.has_security_group_logging(os_id): False [ 881.942304] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.942697] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.942697] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.942940] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.943048] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.943291] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.943413] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.943475] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.943707] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.943707] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.943953] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.944068] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.944132] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.944289] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.944397] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.944742] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.944742] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.944884] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.944941] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.945025] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.945101] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b99e414b-ff9c-4d19-b3c8-32ab58288d75 is going to be updated. [ 882.009357] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.009526] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.009595] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.009985] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.009985] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.027241] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b99e414b-ff9c-4d19-b3c8-32ab58288d75 in Status: IN_PROGRESS for 2s [ 882.316622] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 397559b2-3c5a-424d-b09d-43a25d2abba6 in Status: SUCCESS [ 882.316942] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-397559b2-3c5a-424d-b09d-43a25d2abba6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.375602] env[69188]: INFO networking_nsxv3.common.synchronization [req-274a8911-f013-45d1-9898-30526349b093 req-8fb153c7-8e81-4cbc-bf9d-95f0a91232ae tempest-ImagesTestJSON-2034330654 tempest-ImagesTestJSON-2034330654-project-member] Enqueued Resource ID: 199db626-eef5-4a20-b92a-585841c1cff4 with Priority: HIGHEST for action security_group_members [ 882.376137] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 199db626-eef5-4a20-b92a-585841c1cff4 with Priority: HIGHEST for action security_group_members [ 882.376472] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-199db626-eef5-4a20-b92a-585841c1cff4 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.376614] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-199db626-eef5-4a20-b92a-585841c1cff4" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.376701] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-199db626-eef5-4a20-b92a-585841c1cff4" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.376912] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-199db626-eef5-4a20-b92a-585841c1cff4" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.377094] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.377209] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.377273] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.377402] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.377483] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.377718] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('199db626-eef5-4a20-b92a-585841c1cff4',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.735485] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock network-410 taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.735749] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "network-410" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.735908] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "network-410" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.736544] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "network-410" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.738698] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.739022] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.739153] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.739478] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.739692] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.739958] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 882.740126] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] NeedRegenerationException {{(pid=69188) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 882.740274] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] no value, waiting for create lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 882.740432] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] value creation lock acquired {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 882.740585] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 882.740712] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Calling creation function for not-yet-present value {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 882.740881] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 882.771548] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 882.771548] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Cache value generated in 0.031 seconds for key(s): 'zone-id' {{(pid=69188) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 882.771752] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Released creation lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 882.771892] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "network-410" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.772129] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock port-bea24940-de84-42d6-9332-d23a9e106b6c taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.772321] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "port-bea24940-de84-42d6-9332-d23a9e106b6c" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.772439] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "port-bea24940-de84-42d6-9332-d23a9e106b6c" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.772790] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "port-bea24940-de84-42d6-9332-d23a9e106b6c" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.772931] env[69188]: DEBUG networking_nsxv3.api.rpc [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bea24940-de84-42d6-9332-d23a9e106b6c',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.879840] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.879840] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.879991] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.881059] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.881059] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.881059] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.881059] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.881059] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.881313] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.881313] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.881484] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 199db626-eef5-4a20-b92a-585841c1cff4 is going to be updated. [ 882.936309] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.936309] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.936309] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.936502] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.936549] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.946251] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 199db626-eef5-4a20-b92a-585841c1cff4 in Status: IN_PROGRESS for 2s [ 883.272164] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5e76d42e-7ec6-4a5e-aa9c-c5a285d62318 in Status: SUCCESS [ 883.272164] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e76d42e-7ec6-4a5e-aa9c-c5a285d62318" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.272164] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e76d42e-7ec6-4a5e-aa9c-c5a285d62318" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.272164] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e76d42e-7ec6-4a5e-aa9c-c5a285d62318" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.272164] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.272164] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.272164] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.272164] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.272164] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.272164] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e76d42e-7ec6-4a5e-aa9c-c5a285d62318" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.272164] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5e76d42e-7ec6-4a5e-aa9c-c5a285d62318',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.276918] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.276996] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.277168] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.277726] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.277726] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.277726] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Segment Port bea24940-de84-42d6-9332-d23a9e106b6c not found, creating... [ 883.278515] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.278710] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.278838] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.279073] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.279240] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.279526] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.279684] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.279816] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.280056] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.280200] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.280346] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Resource: SegmentPort with ID: bea24940-de84-42d6-9332-d23a9e106b6c is going to be created. [ 883.299210] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.299701] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.299701] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.299917] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.300303] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.300372] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "port-bea24940-de84-42d6-9332-d23a9e106b6c" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.774154] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e76d42e-7ec6-4a5e-aa9c-c5a285d62318 taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.774629] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e76d42e-7ec6-4a5e-aa9c-c5a285d62318" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.774629] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e76d42e-7ec6-4a5e-aa9c-c5a285d62318" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.774790] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e76d42e-7ec6-4a5e-aa9c-c5a285d62318" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.774897] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.774973] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.775053] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.775270] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.775403] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.775501] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e76d42e-7ec6-4a5e-aa9c-c5a285d62318" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.775667] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e76d42e-7ec6-4a5e-aa9c-c5a285d62318 taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.775760] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e76d42e-7ec6-4a5e-aa9c-c5a285d62318" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.775823] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e76d42e-7ec6-4a5e-aa9c-c5a285d62318" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.776046] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e76d42e-7ec6-4a5e-aa9c-c5a285d62318" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.776280] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.776360] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.776401] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.776540] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.776618] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.776723] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e76d42e-7ec6-4a5e-aa9c-c5a285d62318" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.776863] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5e76d42e-7ec6-4a5e-aa9c-c5a285d62318',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.041749] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b99e414b-ff9c-4d19-b3c8-32ab58288d75 in Status: SUCCESS [ 884.041749] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b99e414b-ff9c-4d19-b3c8-32ab58288d75" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.185302] env[69188]: INFO networking_nsxv3.common.synchronization [req-274a8911-f013-45d1-9898-30526349b093 req-9845260f-b736-4ce6-957e-e82db7475b8b service nova] Enqueued Resource ID: 199db626-eef5-4a20-b92a-585841c1cff4 with Priority: HIGHEST for action security_group_rules [ 884.185484] env[69188]: INFO networking_nsxv3.common.synchronization [req-274a8911-f013-45d1-9898-30526349b093 req-9845260f-b736-4ce6-957e-e82db7475b8b service nova] Enqueued Resource ID: 199db626-eef5-4a20-b92a-585841c1cff4 with Priority: HIGHEST for action security_group_members [ 884.185626] env[69188]: INFO networking_nsxv3.common.synchronization [req-274a8911-f013-45d1-9898-30526349b093 req-9845260f-b736-4ce6-957e-e82db7475b8b service nova] Enqueued Resource ID: bea24940-de84-42d6-9332-d23a9e106b6c with Priority: HIGHEST for action port [ 884.185862] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 199db626-eef5-4a20-b92a-585841c1cff4 with Priority: HIGHEST for action security_group_rules [ 884.185986] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 199db626-eef5-4a20-b92a-585841c1cff4 with Priority: HIGHEST for action security_group_members [ 884.186093] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bea24940-de84-42d6-9332-d23a9e106b6c with Priority: HIGHEST for action port [ 884.191349] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-199db626-eef5-4a20-b92a-585841c1cff4 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.191349] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-199db626-eef5-4a20-b92a-585841c1cff4" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.191349] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-199db626-eef5-4a20-b92a-585841c1cff4" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.191349] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-199db626-eef5-4a20-b92a-585841c1cff4" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.191349] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('199db626-eef5-4a20-b92a-585841c1cff4',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.191349] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-199db626-eef5-4a20-b92a-585841c1cff4 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.191349] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-199db626-eef5-4a20-b92a-585841c1cff4" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.191349] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-bea24940-de84-42d6-9332-d23a9e106b6c taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.191349] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bea24940-de84-42d6-9332-d23a9e106b6c" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.191349] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bea24940-de84-42d6-9332-d23a9e106b6c" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.191349] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bea24940-de84-42d6-9332-d23a9e106b6c" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.191349] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bea24940-de84-42d6-9332-d23a9e106b6c',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.279930] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5e76d42e-7ec6-4a5e-aa9c-c5a285d62318: rpc.has_security_group_logging(os_id): False [ 884.307167] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.307167] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.307167] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.307167] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.327897] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.328143] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.328281] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.329345] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.329345] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.329345] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.329345] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.329345] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.329345] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.329345] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.329345] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.329797] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.329797] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.329797] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.329797] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.329797] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.329797] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5e76d42e-7ec6-4a5e-aa9c-c5a285d62318 is going to be updated. [ 884.375025] env[69188]: INFO networking_nsxv3.common.synchronization [req-0f0cb148-f044-4b8e-b112-fc010b16cf1a req-add0b3a7-fb3d-4b57-aa02-afbcf1f0dfa3 tempest-MultipleCreateTestJSON-27366217 tempest-MultipleCreateTestJSON-27366217-project-member] Enqueued Resource ID: 7f98bc00-dbd3-411c-a67a-14369145489a with Priority: HIGHEST for action security_group_members [ 884.375025] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f98bc00-dbd3-411c-a67a-14369145489a with Priority: HIGHEST for action security_group_members [ 884.375025] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-7f98bc00-dbd3-411c-a67a-14369145489a taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.375025] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7f98bc00-dbd3-411c-a67a-14369145489a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.375025] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7f98bc00-dbd3-411c-a67a-14369145489a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.375025] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7f98bc00-dbd3-411c-a67a-14369145489a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.375025] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.375025] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.375025] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.375025] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.375025] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.376830] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7f98bc00-dbd3-411c-a67a-14369145489a',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.395578] env[69188]: INFO networking_nsxv3.common.synchronization [req-cb7d9535-b51a-4877-a3c0-402149bcfb07 req-52f40301-f57d-42c9-ad47-41f3c83c8469 tempest-MultipleCreateTestJSON-27366217 tempest-MultipleCreateTestJSON-27366217-project-member] Enqueued Resource ID: 7f98bc00-dbd3-411c-a67a-14369145489a with Priority: HIGHEST for action security_group_members [ 884.395578] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f98bc00-dbd3-411c-a67a-14369145489a with Priority: HIGHEST for action security_group_members [ 884.395578] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-7f98bc00-dbd3-411c-a67a-14369145489a taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.395578] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7f98bc00-dbd3-411c-a67a-14369145489a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.412046] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.412250] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.412250] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.413108] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.413108] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.442382] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5e76d42e-7ec6-4a5e-aa9c-c5a285d62318 in Status: IN_PROGRESS for 2s [ 884.695186] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-199db626-eef5-4a20-b92a-585841c1cff4 taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.695387] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-199db626-eef5-4a20-b92a-585841c1cff4" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.695659] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bea24940-de84-42d6-9332-d23a9e106b6c with status ACTIVE [ 884.695851] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.695976] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.696066] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.696375] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.696524] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.696724] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.696828] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.696892] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.697062] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.697142] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.697320] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.697414] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.697472] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.697610] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.697683] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.697766] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bea24940-de84-42d6-9332-d23a9e106b6c is going to be updated. [ 884.721678] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.721904] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.721904] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.722123] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.722254] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.722419] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bea24940-de84-42d6-9332-d23a9e106b6c" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.879481] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.879971] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.879971] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.880287] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.880287] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.880578] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.880680] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.880747] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.880964] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.881092] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.881230] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7f98bc00-dbd3-411c-a67a-14369145489a is going to be updated. [ 884.907877] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.908055] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.908133] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.908418] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.908566] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.917750] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7f98bc00-dbd3-411c-a67a-14369145489a in Status: IN_PROGRESS for 2s [ 884.958034] env[69188]: INFO networking_nsxv3.common.synchronization [req-d79970ce-4825-43bb-b1de-d5dfaedec601 req-b0fa5552-9563-4619-b012-51e7e84dda03 tempest-ServersV294TestFqdnHostnames-1833622075 tempest-ServersV294TestFqdnHostnames-1833622075-project-member] Enqueued Resource ID: 2dad819d-4da9-4798-827e-298c399b35c5 with Priority: HIGHEST for action security_group_members [ 884.958034] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 199db626-eef5-4a20-b92a-585841c1cff4 in Status: SUCCESS [ 884.958034] env[69188]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 199db626-eef5-4a20-b92a-585841c1cff4 deletion is rescheduled due to dependency. [ 884.958034] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-199db626-eef5-4a20-b92a-585841c1cff4" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.959183] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2dad819d-4da9-4798-827e-298c399b35c5 with Priority: HIGHEST for action security_group_members [ 884.959605] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-199db626-eef5-4a20-b92a-585841c1cff4" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.960703] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-199db626-eef5-4a20-b92a-585841c1cff4" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.962049] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.964493] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.964493] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.964493] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.964493] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.964493] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('199db626-eef5-4a20-b92a-585841c1cff4',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.964493] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-2dad819d-4da9-4798-827e-298c399b35c5 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.964493] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2dad819d-4da9-4798-827e-298c399b35c5" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.964493] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2dad819d-4da9-4798-827e-298c399b35c5" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.964493] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2dad819d-4da9-4798-827e-298c399b35c5" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.964493] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.964493] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.964493] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.970479] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.970479] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.970479] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2dad819d-4da9-4798-827e-298c399b35c5',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 885.165533] env[69188]: INFO networking_nsxv3.common.synchronization [req-21183c6c-b3c5-43b4-b678-116ea36e8919 req-42ebce1d-25a7-4342-86d4-213f54eecbbe tempest-AttachInterfacesUnderV243Test-1529073749 tempest-AttachInterfacesUnderV243Test-1529073749-project-member] Enqueued Resource ID: e4039e1d-9712-484a-9e32-16f2dc6c2311 with Priority: HIGHEST for action security_group_members [ 885.166277] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e4039e1d-9712-484a-9e32-16f2dc6c2311 with Priority: HIGHEST for action security_group_members [ 885.166650] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-e4039e1d-9712-484a-9e32-16f2dc6c2311 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.166787] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e4039e1d-9712-484a-9e32-16f2dc6c2311" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.166851] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e4039e1d-9712-484a-9e32-16f2dc6c2311" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.167126] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e4039e1d-9712-484a-9e32-16f2dc6c2311" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.167296] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.167407] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.167467] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.167622] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.167707] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.167812] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e4039e1d-9712-484a-9e32-16f2dc6c2311',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 885.469072] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.469341] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.469440] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.469699] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.469980] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.470282] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.470418] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.470519] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.470756] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.471049] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.471184] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2dad819d-4da9-4798-827e-298c399b35c5 is going to be updated. [ 885.473336] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('199db626-eef5-4a20-b92a-585841c1cff4',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 885.498896] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.499456] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.500011] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.500011] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.500011] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.511674] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2dad819d-4da9-4798-827e-298c399b35c5 in Status: IN_PROGRESS for 2s [ 885.605029] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock network-665 taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.605029] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "network-665" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.605029] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "network-665" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.605246] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "network-665" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.605440] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.605604] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.605726] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.606017] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.606195] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.606416] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 885.606532] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] NeedRegenerationException {{(pid=69188) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 885.606643] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] no value, waiting for create lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 885.606751] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] value creation lock acquired {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 885.606861] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 885.606968] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Calling creation function for not-yet-present value {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 885.607121] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 885.624699] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 885.624877] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69188) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 885.625035] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Released creation lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 885.625251] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "network-665" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.625575] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock port-6e07ff78-73eb-473b-8e22-21cfea849f70 taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.625750] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "port-6e07ff78-73eb-473b-8e22-21cfea849f70" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.625873] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "port-6e07ff78-73eb-473b-8e22-21cfea849f70" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.626969] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "port-6e07ff78-73eb-473b-8e22-21cfea849f70" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.626969] env[69188]: DEBUG networking_nsxv3.api.rpc [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6e07ff78-73eb-473b-8e22-21cfea849f70',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 885.671056] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.671237] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.671309] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.671790] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.671790] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.671931] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.671931] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.672037] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.672132] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.675019] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.675019] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e4039e1d-9712-484a-9e32-16f2dc6c2311 already deleted. [ 885.675019] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e4039e1d-9712-484a-9e32-16f2dc6c2311" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.976013] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('199db626-eef5-4a20-b92a-585841c1cff4',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.130714] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.131362] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.131362] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.131459] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.131561] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.131708] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Segment Port 6e07ff78-73eb-473b-8e22-21cfea849f70 not found, creating... [ 886.131983] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.132159] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.132280] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.132497] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.132636] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.132918] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.133090] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.133210] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.133418] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.133558] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.133721] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Resource: SegmentPort with ID: 6e07ff78-73eb-473b-8e22-21cfea849f70 is going to be created. [ 886.155447] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.155447] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.155447] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.155447] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.155878] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.155878] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "port-6e07ff78-73eb-473b-8e22-21cfea849f70" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.460045] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5e76d42e-7ec6-4a5e-aa9c-c5a285d62318 in Status: SUCCESS [ 886.460045] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5e76d42e-7ec6-4a5e-aa9c-c5a285d62318" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.482262] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.482262] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.482262] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.482414] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.482414] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.482521] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 199db626-eef5-4a20-b92a-585841c1cff4 is going to be updated. [ 886.513026] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.513026] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.513026] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.513266] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.513343] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.522429] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 199db626-eef5-4a20-b92a-585841c1cff4 in Status: IN_PROGRESS for 2s [ 886.915541] env[69188]: INFO networking_nsxv3.common.synchronization [req-21183c6c-b3c5-43b4-b678-116ea36e8919 req-88a36c7d-3c13-4191-afc9-c454844a1662 service nova] Enqueued Resource ID: e4039e1d-9712-484a-9e32-16f2dc6c2311 with Priority: HIGHEST for action security_group_rules [ 886.915721] env[69188]: INFO networking_nsxv3.common.synchronization [req-21183c6c-b3c5-43b4-b678-116ea36e8919 req-88a36c7d-3c13-4191-afc9-c454844a1662 service nova] Enqueued Resource ID: e4039e1d-9712-484a-9e32-16f2dc6c2311 with Priority: HIGHEST for action security_group_members [ 886.915880] env[69188]: INFO networking_nsxv3.common.synchronization [req-21183c6c-b3c5-43b4-b678-116ea36e8919 req-88a36c7d-3c13-4191-afc9-c454844a1662 service nova] Enqueued Resource ID: 6e07ff78-73eb-473b-8e22-21cfea849f70 with Priority: HIGHEST for action port [ 886.916137] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e4039e1d-9712-484a-9e32-16f2dc6c2311 with Priority: HIGHEST for action security_group_rules [ 886.916277] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e4039e1d-9712-484a-9e32-16f2dc6c2311 with Priority: HIGHEST for action security_group_members [ 886.916390] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e07ff78-73eb-473b-8e22-21cfea849f70 with Priority: HIGHEST for action port [ 886.916971] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e4039e1d-9712-484a-9e32-16f2dc6c2311 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.917241] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e4039e1d-9712-484a-9e32-16f2dc6c2311" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.917327] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e4039e1d-9712-484a-9e32-16f2dc6c2311" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.917691] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e4039e1d-9712-484a-9e32-16f2dc6c2311" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.917691] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e4039e1d-9712-484a-9e32-16f2dc6c2311',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.918566] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-e4039e1d-9712-484a-9e32-16f2dc6c2311 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.918677] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e4039e1d-9712-484a-9e32-16f2dc6c2311" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.918746] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e4039e1d-9712-484a-9e32-16f2dc6c2311" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.918907] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e4039e1d-9712-484a-9e32-16f2dc6c2311" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.919070] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.919177] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.919254] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.919377] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.919460] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.919558] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e4039e1d-9712-484a-9e32-16f2dc6c2311',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.920365] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-6e07ff78-73eb-473b-8e22-21cfea849f70 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.920473] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6e07ff78-73eb-473b-8e22-21cfea849f70" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.920548] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6e07ff78-73eb-473b-8e22-21cfea849f70" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.920700] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6e07ff78-73eb-473b-8e22-21cfea849f70" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.920775] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6e07ff78-73eb-473b-8e22-21cfea849f70',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.938412] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7f98bc00-dbd3-411c-a67a-14369145489a in Status: SUCCESS [ 886.938597] env[69188]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7f98bc00-dbd3-411c-a67a-14369145489a deletion is rescheduled due to dependency. [ 886.938712] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7f98bc00-dbd3-411c-a67a-14369145489a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.939246] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7f98bc00-dbd3-411c-a67a-14369145489a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.939487] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7f98bc00-dbd3-411c-a67a-14369145489a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.939678] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.939791] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.939864] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.940019] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.940097] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.940188] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7f98bc00-dbd3-411c-a67a-14369145489a',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.433022] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e4039e1d-9712-484a-9e32-16f2dc6c2311',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.433022] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-e4039e1d-9712-484a-9e32-16f2dc6c2311 taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.433022] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e4039e1d-9712-484a-9e32-16f2dc6c2311" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.433022] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6e07ff78-73eb-473b-8e22-21cfea849f70 with status ACTIVE [ 887.433022] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.433022] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.433022] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.433022] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.433022] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.433022] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.433022] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.433022] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.433022] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.433022] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.434730] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.441624] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.441624] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.441624] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.441624] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.441624] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6e07ff78-73eb-473b-8e22-21cfea849f70 is going to be updated. [ 887.445026] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.445026] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.445026] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.445026] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.445026] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.445026] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.445026] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.445026] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.445026] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.445026] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.445026] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7f98bc00-dbd3-411c-a67a-14369145489a is going to be updated. [ 887.472158] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.472158] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.472158] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.472158] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.472158] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.472158] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6e07ff78-73eb-473b-8e22-21cfea849f70" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.477496] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.480722] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.480722] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.480722] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.480722] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.489758] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7f98bc00-dbd3-411c-a67a-14369145489a in Status: IN_PROGRESS for 2s [ 887.527660] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2dad819d-4da9-4798-827e-298c399b35c5 in Status: SUCCESS [ 887.527660] env[69188]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2dad819d-4da9-4798-827e-298c399b35c5 deletion is rescheduled due to dependency. [ 887.527660] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2dad819d-4da9-4798-827e-298c399b35c5" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.942107] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e4039e1d-9712-484a-9e32-16f2dc6c2311',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.962686] env[69188]: INFO networking_nsxv3.common.synchronization [req-13f109aa-4026-4a0e-9de1-32a51ec917e8 req-22696891-ed6e-46b3-808c-e90486d3eda9 tempest-ServersWithSpecificFlavorTestJSON-1359499520 tempest-ServersWithSpecificFlavorTestJSON-1359499520-project-member] Enqueued Resource ID: ec45d27b-caa2-4488-8317-d6595de404b8 with Priority: HIGHEST for action security_group_members [ 887.963202] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ec45d27b-caa2-4488-8317-d6595de404b8 with Priority: HIGHEST for action security_group_members [ 887.964068] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-ec45d27b-caa2-4488-8317-d6595de404b8 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.964209] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ec45d27b-caa2-4488-8317-d6595de404b8" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.964275] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ec45d27b-caa2-4488-8317-d6595de404b8" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.964475] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ec45d27b-caa2-4488-8317-d6595de404b8" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.964644] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.964728] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.964789] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.964929] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.965036] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.965128] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ec45d27b-caa2-4488-8317-d6595de404b8',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.444655] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.445041] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.445041] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.445202] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.445483] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.445483] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e4039e1d-9712-484a-9e32-16f2dc6c2311 is going to be created. [ 888.467540] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.467698] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.467771] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.468123] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.468123] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.468391] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.468500] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.468561] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.468707] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.468786] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.468875] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ec45d27b-caa2-4488-8317-d6595de404b8 is going to be updated. [ 888.483029] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.483029] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.483029] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.483029] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.483029] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.496702] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e4039e1d-9712-484a-9e32-16f2dc6c2311 in Status: UNINITIALIZED for 2s [ 888.512811] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.512811] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.512811] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.512811] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.512811] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.522379] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ec45d27b-caa2-4488-8317-d6595de404b8 in Status: IN_PROGRESS for 2s [ 888.532150] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 199db626-eef5-4a20-b92a-585841c1cff4 in Status: SUCCESS [ 888.532446] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-199db626-eef5-4a20-b92a-585841c1cff4" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.532565] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-199db626-eef5-4a20-b92a-585841c1cff4" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.532779] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-199db626-eef5-4a20-b92a-585841c1cff4" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.532985] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.533177] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.533244] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.533398] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.533479] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.533559] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-199db626-eef5-4a20-b92a-585841c1cff4" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.533676] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('199db626-eef5-4a20-b92a-585841c1cff4',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 889.036767] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-199db626-eef5-4a20-b92a-585841c1cff4 taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.036980] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-199db626-eef5-4a20-b92a-585841c1cff4" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.037097] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-199db626-eef5-4a20-b92a-585841c1cff4" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.037373] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-199db626-eef5-4a20-b92a-585841c1cff4" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.037578] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.037700] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.037788] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.037989] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.038107] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.038200] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-199db626-eef5-4a20-b92a-585841c1cff4" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.038391] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-199db626-eef5-4a20-b92a-585841c1cff4 taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.038504] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-199db626-eef5-4a20-b92a-585841c1cff4" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.038581] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-199db626-eef5-4a20-b92a-585841c1cff4" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.038769] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-199db626-eef5-4a20-b92a-585841c1cff4" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.038933] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.039117] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.039117] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.039286] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.039400] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.039497] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-199db626-eef5-4a20-b92a-585841c1cff4" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.039617] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('199db626-eef5-4a20-b92a-585841c1cff4',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 889.500988] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7f98bc00-dbd3-411c-a67a-14369145489a in Status: SUCCESS [ 889.501264] env[69188]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7f98bc00-dbd3-411c-a67a-14369145489a deletion is rescheduled due to dependency. [ 889.501330] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7f98bc00-dbd3-411c-a67a-14369145489a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.544065] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 199db626-eef5-4a20-b92a-585841c1cff4: rpc.has_security_group_logging(os_id): False [ 889.562652] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.563525] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.563525] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.563525] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.563525] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.563688] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.563748] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.563855] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.564086] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.564198] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.564479] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.564651] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.564651] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.564831] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.564933] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.565159] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.565286] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.565375] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.565540] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.565649] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.566404] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 199db626-eef5-4a20-b92a-585841c1cff4 is going to be updated. [ 889.632055] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.632211] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.632283] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.632504] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.632647] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.649704] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 199db626-eef5-4a20-b92a-585841c1cff4 in Status: IN_PROGRESS for 2s [ 890.507685] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e4039e1d-9712-484a-9e32-16f2dc6c2311 in Status: SUCCESS [ 890.507988] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e4039e1d-9712-484a-9e32-16f2dc6c2311" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.508212] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e4039e1d-9712-484a-9e32-16f2dc6c2311" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.508709] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e4039e1d-9712-484a-9e32-16f2dc6c2311" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.508918] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.509056] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.509126] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.509387] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.509508] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.509605] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e4039e1d-9712-484a-9e32-16f2dc6c2311" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.509695] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e4039e1d-9712-484a-9e32-16f2dc6c2311',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.531137] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ec45d27b-caa2-4488-8317-d6595de404b8 in Status: SUCCESS [ 890.532228] env[69188]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ec45d27b-caa2-4488-8317-d6595de404b8 deletion is rescheduled due to dependency. [ 890.532510] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ec45d27b-caa2-4488-8317-d6595de404b8" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.013250] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e4039e1d-9712-484a-9e32-16f2dc6c2311',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.517689] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e4039e1d-9712-484a-9e32-16f2dc6c2311: rpc.has_security_group_logging(os_id): False [ 891.539467] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.539467] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.539467] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.539467] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.539467] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.539467] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.539467] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.539467] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.539467] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.539467] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.539467] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e4039e1d-9712-484a-9e32-16f2dc6c2311 is going to be created. [ 891.611997] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.612249] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.612249] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.612720] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.612720] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.624163] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e4039e1d-9712-484a-9e32-16f2dc6c2311 in Status: IN_PROGRESS for 2s [ 891.667101] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 199db626-eef5-4a20-b92a-585841c1cff4 in Status: SUCCESS [ 891.667399] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-199db626-eef5-4a20-b92a-585841c1cff4" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.470836] env[69188]: INFO networking_nsxv3.common.synchronization [req-704966e1-f528-4123-ad56-676b73ec0e31 req-fd2fb8c1-2c12-468a-8d33-f0b1634a8056 tempest-ServerActionsV293TestJSON-1161713519 tempest-ServerActionsV293TestJSON-1161713519-project-member] Enqueued Resource ID: 8f01fd17-613c-4bd7-9c6b-8b39ac58be72 with Priority: HIGHEST for action security_group_members [ 892.471378] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f01fd17-613c-4bd7-9c6b-8b39ac58be72 with Priority: HIGHEST for action security_group_members [ 892.471677] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-8f01fd17-613c-4bd7-9c6b-8b39ac58be72 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.471800] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8f01fd17-613c-4bd7-9c6b-8b39ac58be72" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.471867] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8f01fd17-613c-4bd7-9c6b-8b39ac58be72" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.472331] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8f01fd17-613c-4bd7-9c6b-8b39ac58be72" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.472502] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.472608] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.472677] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.474549] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.474654] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.474755] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8f01fd17-613c-4bd7-9c6b-8b39ac58be72',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.904684] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock network-610 taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.905110] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "network-610" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.905110] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "network-610" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.905378] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "network-610" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.905833] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.905984] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.906124] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.906731] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.906731] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.906862] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 892.906862] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] NeedRegenerationException {{(pid=69188) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 892.906976] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] no value, waiting for create lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 892.907132] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] value creation lock acquired {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 892.907380] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 892.907420] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Calling creation function for not-yet-present value {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 892.907575] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 892.927037] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 892.927379] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69188) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 892.927552] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Released creation lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 892.927751] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "network-610" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.928117] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock port-8cc7a657-cc1e-4df3-92ae-e4a20ba7caac taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.928373] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "port-8cc7a657-cc1e-4df3-92ae-e4a20ba7caac" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.928570] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "port-8cc7a657-cc1e-4df3-92ae-e4a20ba7caac" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.928914] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "port-8cc7a657-cc1e-4df3-92ae-e4a20ba7caac" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.929074] env[69188]: DEBUG networking_nsxv3.api.rpc [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8cc7a657-cc1e-4df3-92ae-e4a20ba7caac',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.976865] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.977022] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.977106] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.977534] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.977634] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.977821] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.977932] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.978066] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.978169] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.978244] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.978382] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8f01fd17-613c-4bd7-9c6b-8b39ac58be72 already deleted. [ 892.978530] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8f01fd17-613c-4bd7-9c6b-8b39ac58be72" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.431457] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.431728] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.431895] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.432299] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.432508] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.432686] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Segment Port 8cc7a657-cc1e-4df3-92ae-e4a20ba7caac not found, creating... [ 893.432960] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.433138] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.433260] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.433493] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.433638] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.434012] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.434198] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.434326] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.434540] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.434682] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.434826] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Resource: SegmentPort with ID: 8cc7a657-cc1e-4df3-92ae-e4a20ba7caac is going to be created. [ 893.453986] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.454233] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.454364] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.454649] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.454885] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.455149] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "port-8cc7a657-cc1e-4df3-92ae-e4a20ba7caac" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.638622] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e4039e1d-9712-484a-9e32-16f2dc6c2311 in Status: SUCCESS [ 893.638876] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e4039e1d-9712-484a-9e32-16f2dc6c2311" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.197938] env[69188]: INFO networking_nsxv3.common.synchronization [req-704966e1-f528-4123-ad56-676b73ec0e31 req-a5d327a6-d74d-44f5-a1f0-dc75e5052c70 service nova] Enqueued Resource ID: 8f01fd17-613c-4bd7-9c6b-8b39ac58be72 with Priority: HIGHEST for action security_group_rules [ 894.197938] env[69188]: INFO networking_nsxv3.common.synchronization [req-704966e1-f528-4123-ad56-676b73ec0e31 req-a5d327a6-d74d-44f5-a1f0-dc75e5052c70 service nova] Enqueued Resource ID: 8f01fd17-613c-4bd7-9c6b-8b39ac58be72 with Priority: HIGHEST for action security_group_members [ 894.197938] env[69188]: INFO networking_nsxv3.common.synchronization [req-704966e1-f528-4123-ad56-676b73ec0e31 req-a5d327a6-d74d-44f5-a1f0-dc75e5052c70 service nova] Enqueued Resource ID: 8cc7a657-cc1e-4df3-92ae-e4a20ba7caac with Priority: HIGHEST for action port [ 894.197938] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f01fd17-613c-4bd7-9c6b-8b39ac58be72 with Priority: HIGHEST for action security_group_rules [ 894.197938] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f01fd17-613c-4bd7-9c6b-8b39ac58be72 with Priority: HIGHEST for action security_group_members [ 894.197938] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8cc7a657-cc1e-4df3-92ae-e4a20ba7caac with Priority: HIGHEST for action port [ 894.199630] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8f01fd17-613c-4bd7-9c6b-8b39ac58be72 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.199803] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8f01fd17-613c-4bd7-9c6b-8b39ac58be72" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.199876] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8f01fd17-613c-4bd7-9c6b-8b39ac58be72" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.200106] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8f01fd17-613c-4bd7-9c6b-8b39ac58be72" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.201256] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8f01fd17-613c-4bd7-9c6b-8b39ac58be72',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.201381] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-8f01fd17-613c-4bd7-9c6b-8b39ac58be72 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.201607] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8f01fd17-613c-4bd7-9c6b-8b39ac58be72" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.201697] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8f01fd17-613c-4bd7-9c6b-8b39ac58be72" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.201876] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8f01fd17-613c-4bd7-9c6b-8b39ac58be72" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.202116] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.202225] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.202288] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.202457] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.202611] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.202672] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8f01fd17-613c-4bd7-9c6b-8b39ac58be72',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.204451] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-8cc7a657-cc1e-4df3-92ae-e4a20ba7caac taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.204451] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8cc7a657-cc1e-4df3-92ae-e4a20ba7caac" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.204651] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8cc7a657-cc1e-4df3-92ae-e4a20ba7caac" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.204651] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8cc7a657-cc1e-4df3-92ae-e4a20ba7caac" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.205661] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8cc7a657-cc1e-4df3-92ae-e4a20ba7caac',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.707523] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-8f01fd17-613c-4bd7-9c6b-8b39ac58be72 taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.707677] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8f01fd17-613c-4bd7-9c6b-8b39ac58be72" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.707885] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8f01fd17-613c-4bd7-9c6b-8b39ac58be72',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.708958] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8cc7a657-cc1e-4df3-92ae-e4a20ba7caac with status ACTIVE [ 894.709702] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.709702] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.709702] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.709702] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.709702] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.709958] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.709958] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.710053] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.710207] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.710272] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.710536] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.710602] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.710645] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.710791] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.710905] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.710962] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8cc7a657-cc1e-4df3-92ae-e4a20ba7caac is going to be updated. [ 894.730585] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.730815] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.730900] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.731466] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.732344] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.732344] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8cc7a657-cc1e-4df3-92ae-e4a20ba7caac" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.109552] env[69188]: INFO networking_nsxv3.common.synchronization [req-1dc833d6-e4a6-4c70-b20e-127ab33b96d5 req-ef0ca649-f020-4390-bffe-f73f678ed1a4 tempest-ServersTestMultiNic-1128640872 tempest-ServersTestMultiNic-1128640872-project-member] Enqueued Resource ID: d7156740-676b-417b-9850-f10d741c20bd with Priority: HIGHEST for action security_group_members [ 895.110105] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d7156740-676b-417b-9850-f10d741c20bd with Priority: HIGHEST for action security_group_members [ 895.110411] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-d7156740-676b-417b-9850-f10d741c20bd taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.110528] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d7156740-676b-417b-9850-f10d741c20bd" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.110625] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d7156740-676b-417b-9850-f10d741c20bd" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.110838] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d7156740-676b-417b-9850-f10d741c20bd" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.111007] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.111149] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.111209] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.111399] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.111502] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.111614] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d7156740-676b-417b-9850-f10d741c20bd',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.213597] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8f01fd17-613c-4bd7-9c6b-8b39ac58be72',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.505390] env[69188]: INFO networking_nsxv3.common.synchronization [req-1dc833d6-e4a6-4c70-b20e-127ab33b96d5 req-99581cb2-0c8c-48e1-bc0a-1622ab5f5b4c tempest-ServersTestMultiNic-1128640872 tempest-ServersTestMultiNic-1128640872-project-member] Enqueued Resource ID: d7156740-676b-417b-9850-f10d741c20bd with Priority: HIGHEST for action security_group_members [ 895.505966] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d7156740-676b-417b-9850-f10d741c20bd with Priority: HIGHEST for action security_group_members [ 895.506299] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-d7156740-676b-417b-9850-f10d741c20bd taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.506406] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d7156740-676b-417b-9850-f10d741c20bd" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.614620] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.614620] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.614620] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.614620] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.614620] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.614897] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.614897] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.614897] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.614985] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.615063] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.615149] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d7156740-676b-417b-9850-f10d741c20bd is going to be deleted. [ 895.642491] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.642650] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.642699] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.642921] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.643040] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.643148] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d7156740-676b-417b-9850-f10d741c20bd" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.643304] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d7156740-676b-417b-9850-f10d741c20bd" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.643466] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d7156740-676b-417b-9850-f10d741c20bd" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.643625] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.643723] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.643785] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.643928] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.644016] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.644112] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d7156740-676b-417b-9850-f10d741c20bd',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.715266] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.715488] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.715563] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.715809] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.715906] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.716023] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8f01fd17-613c-4bd7-9c6b-8b39ac58be72 is going to be created. [ 895.753350] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.753495] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.753577] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.753791] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.753965] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.763620] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8f01fd17-613c-4bd7-9c6b-8b39ac58be72 in Status: UNINITIALIZED for 2s [ 895.933920] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock network-474 taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.934153] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "network-474" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.934419] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "network-474" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.934634] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "network-474" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.934901] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.935098] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.935220] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.935437] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.935593] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.935807] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 895.935924] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] NeedRegenerationException {{(pid=69188) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 895.936054] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] no value, waiting for create lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 895.936168] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] value creation lock acquired {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 895.936336] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 895.936418] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Calling creation function for not-yet-present value {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 895.936561] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 895.953500] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 895.953675] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=69188) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 895.953822] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Released creation lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 895.954107] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "network-474" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.954366] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock port-ebebf69a-7994-45a9-a6fd-367234b9d77b taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.954543] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "port-ebebf69a-7994-45a9-a6fd-367234b9d77b" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.954695] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "port-ebebf69a-7994-45a9-a6fd-367234b9d77b" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.955018] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "port-ebebf69a-7994-45a9-a6fd-367234b9d77b" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.955196] env[69188]: DEBUG networking_nsxv3.api.rpc [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ebebf69a-7994-45a9-a6fd-367234b9d77b',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 896.147288] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.147511] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.147605] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.151283] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.151283] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.151283] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.151283] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.151283] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.151283] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.151283] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.151283] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d7156740-676b-417b-9850-f10d741c20bd already deleted. [ 896.151283] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d7156740-676b-417b-9850-f10d741c20bd" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.459614] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.459918] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.460036] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.460479] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.460570] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.460823] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Segment Port ebebf69a-7994-45a9-a6fd-367234b9d77b not found, creating... [ 896.461207] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.462032] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.462032] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.462032] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.462270] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.462620] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.462803] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.463085] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.463232] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.463438] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.464110] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Resource: SegmentPort with ID: ebebf69a-7994-45a9-a6fd-367234b9d77b is going to be created. [ 896.483465] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.483711] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.483866] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.484210] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.484470] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.484819] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "port-ebebf69a-7994-45a9-a6fd-367234b9d77b" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.310462] env[69188]: INFO networking_nsxv3.common.synchronization [req-1dc833d6-e4a6-4c70-b20e-127ab33b96d5 req-f2ddf003-22f0-43c6-abf9-32c56bc6b0d8 service nova] Enqueued Resource ID: d7156740-676b-417b-9850-f10d741c20bd with Priority: HIGHEST for action security_group_rules [ 897.310687] env[69188]: INFO networking_nsxv3.common.synchronization [req-1dc833d6-e4a6-4c70-b20e-127ab33b96d5 req-f2ddf003-22f0-43c6-abf9-32c56bc6b0d8 service nova] Enqueued Resource ID: d7156740-676b-417b-9850-f10d741c20bd with Priority: HIGHEST for action security_group_members [ 897.310849] env[69188]: INFO networking_nsxv3.common.synchronization [req-1dc833d6-e4a6-4c70-b20e-127ab33b96d5 req-f2ddf003-22f0-43c6-abf9-32c56bc6b0d8 service nova] Enqueued Resource ID: ebebf69a-7994-45a9-a6fd-367234b9d77b with Priority: HIGHEST for action port [ 897.311107] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d7156740-676b-417b-9850-f10d741c20bd with Priority: HIGHEST for action security_group_rules [ 897.312850] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d7156740-676b-417b-9850-f10d741c20bd with Priority: HIGHEST for action security_group_members [ 897.312850] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ebebf69a-7994-45a9-a6fd-367234b9d77b with Priority: HIGHEST for action port [ 897.312850] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d7156740-676b-417b-9850-f10d741c20bd taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.312850] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d7156740-676b-417b-9850-f10d741c20bd" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.312850] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d7156740-676b-417b-9850-f10d741c20bd" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.312850] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d7156740-676b-417b-9850-f10d741c20bd" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.312850] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d7156740-676b-417b-9850-f10d741c20bd',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 897.314706] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-d7156740-676b-417b-9850-f10d741c20bd taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.314820] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d7156740-676b-417b-9850-f10d741c20bd" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.314878] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d7156740-676b-417b-9850-f10d741c20bd" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.315163] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d7156740-676b-417b-9850-f10d741c20bd" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.315372] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.315439] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.315497] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.315622] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.315710] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.315806] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d7156740-676b-417b-9850-f10d741c20bd',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 897.318389] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-ebebf69a-7994-45a9-a6fd-367234b9d77b taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.318543] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ebebf69a-7994-45a9-a6fd-367234b9d77b" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.318597] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ebebf69a-7994-45a9-a6fd-367234b9d77b" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.318763] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ebebf69a-7994-45a9-a6fd-367234b9d77b" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.318829] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ebebf69a-7994-45a9-a6fd-367234b9d77b',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 897.778135] env[69188]: INFO networking_nsxv3.common.synchronization [req-cc965843-f9cc-4724-adb1-c82b923bd213 req-99750981-e472-4a46-905a-63a532b68845 tempest-ServerDiskConfigTestJSON-1476779099 tempest-ServerDiskConfigTestJSON-1476779099-project-member] Enqueued Resource ID: 24a7b083-b432-46d6-94de-76adf6ce22b3 with Priority: HIGHEST for action security_group_members [ 897.778836] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 24a7b083-b432-46d6-94de-76adf6ce22b3 with Priority: HIGHEST for action security_group_members [ 897.780235] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8f01fd17-613c-4bd7-9c6b-8b39ac58be72 in Status: SUCCESS [ 897.780502] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8f01fd17-613c-4bd7-9c6b-8b39ac58be72" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.780859] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-24a7b083-b432-46d6-94de-76adf6ce22b3 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.781017] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-24a7b083-b432-46d6-94de-76adf6ce22b3" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.781085] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-24a7b083-b432-46d6-94de-76adf6ce22b3" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.781261] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-24a7b083-b432-46d6-94de-76adf6ce22b3" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.781445] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.781545] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.781615] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.781711] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.781793] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.781888] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('24a7b083-b432-46d6-94de-76adf6ce22b3',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 897.782773] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8f01fd17-613c-4bd7-9c6b-8b39ac58be72" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.782953] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8f01fd17-613c-4bd7-9c6b-8b39ac58be72" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.783183] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.783279] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.783279] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.783511] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.783596] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.783688] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8f01fd17-613c-4bd7-9c6b-8b39ac58be72" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.783781] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8f01fd17-613c-4bd7-9c6b-8b39ac58be72',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 897.815423] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-d7156740-676b-417b-9850-f10d741c20bd taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.815423] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d7156740-676b-417b-9850-f10d741c20bd" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.819805] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d7156740-676b-417b-9850-f10d741c20bd',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 897.825033] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ebebf69a-7994-45a9-a6fd-367234b9d77b with status ACTIVE [ 897.825302] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.825419] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.825491] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.825786] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.825945] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.826101] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.826208] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.826261] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.826445] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.826546] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.826735] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.826832] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.826899] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.827056] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.827150] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.827226] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ebebf69a-7994-45a9-a6fd-367234b9d77b is going to be updated. [ 897.862763] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.862923] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.862997] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.863246] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.863389] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.863564] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ebebf69a-7994-45a9-a6fd-367234b9d77b" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.217562] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock network-722 taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.217784] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "network-722" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.218207] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "network-722" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.218456] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "network-722" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.219038] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.219038] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.219229] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.219386] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.219594] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.219899] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 898.220048] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] NeedRegenerationException {{(pid=69188) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 898.220171] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] no value, waiting for create lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 898.220305] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] value creation lock acquired {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 898.220424] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 898.220536] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Calling creation function for not-yet-present value {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 898.220753] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 898.242206] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 898.242383] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69188) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 898.242525] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Released creation lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 898.242715] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "network-722" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.243158] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock port-78d72166-f709-4942-8bab-fa2e56972ab0 taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.243572] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "port-78d72166-f709-4942-8bab-fa2e56972ab0" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.243572] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "port-78d72166-f709-4942-8bab-fa2e56972ab0" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.243904] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "port-78d72166-f709-4942-8bab-fa2e56972ab0" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.244094] env[69188]: DEBUG networking_nsxv3.api.rpc [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('78d72166-f709-4942-8bab-fa2e56972ab0',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 898.283260] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock network-907 taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.283260] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "network-907" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.283260] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "network-907" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.283260] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "network-907" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.284297] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.284680] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.285736] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.285736] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.285901] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.287071] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 898.287071] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] NeedRegenerationException {{(pid=69188) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 898.287071] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] no value, waiting for create lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 898.287071] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] value creation lock acquired {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 898.287071] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 898.287071] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Calling creation function for not-yet-present value {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 898.287071] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 898.288856] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.288996] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.289121] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.289424] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.289823] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.290071] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.290951] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.290951] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.290951] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.290951] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.290951] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 24a7b083-b432-46d6-94de-76adf6ce22b3 is going to be updated. [ 898.292531] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8f01fd17-613c-4bd7-9c6b-8b39ac58be72',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 898.314025] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 898.314025] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=69188) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 898.314025] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Released creation lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 898.314025] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "network-907" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.314025] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock port-1b20cb32-97a6-4504-acc5-8aab27acc59d taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.314025] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "port-1b20cb32-97a6-4504-acc5-8aab27acc59d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.314025] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "port-1b20cb32-97a6-4504-acc5-8aab27acc59d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.314025] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "port-1b20cb32-97a6-4504-acc5-8aab27acc59d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.314025] env[69188]: DEBUG networking_nsxv3.api.rpc [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1b20cb32-97a6-4504-acc5-8aab27acc59d',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 898.321779] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.321779] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.322039] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.322115] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.322238] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.331471] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d7156740-676b-417b-9850-f10d741c20bd',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 898.333618] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 24a7b083-b432-46d6-94de-76adf6ce22b3 in Status: IN_PROGRESS for 2s [ 898.747931] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.748099] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.748230] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.748673] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.748980] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.749228] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Segment Port 78d72166-f709-4942-8bab-fa2e56972ab0 not found, creating... [ 898.749591] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.749862] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.750126] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.750508] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.750678] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.751045] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.751235] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.751424] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.751837] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.752089] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.752282] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Resource: SegmentPort with ID: 78d72166-f709-4942-8bab-fa2e56972ab0 is going to be created. [ 898.775533] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.775838] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.776443] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.776443] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.776692] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.776937] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "port-78d72166-f709-4942-8bab-fa2e56972ab0" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.795952] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8f01fd17-613c-4bd7-9c6b-8b39ac58be72: rpc.has_security_group_logging(os_id): False [ 898.816696] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.816842] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.817406] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.817406] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.817406] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.817621] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.817760] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.817815] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.817958] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.818049] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.818149] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8f01fd17-613c-4bd7-9c6b-8b39ac58be72 is going to be created. [ 898.820174] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.820418] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.820564] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.820884] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.821065] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.822073] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Segment Port 1b20cb32-97a6-4504-acc5-8aab27acc59d not found, creating... [ 898.822073] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.822073] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.822073] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.822382] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.822382] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.822918] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.822918] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.822918] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.823175] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.823345] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.823486] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Resource: SegmentPort with ID: 1b20cb32-97a6-4504-acc5-8aab27acc59d is going to be created. [ 898.835182] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.835182] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.835182] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.835313] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.835406] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.835477] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d7156740-676b-417b-9850-f10d741c20bd is going to be created. [ 898.867403] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.868267] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.868629] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.870036] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.870036] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.870036] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "port-1b20cb32-97a6-4504-acc5-8aab27acc59d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.891892] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.892063] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.892126] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.892342] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.892517] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.908430] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d7156740-676b-417b-9850-f10d741c20bd in Status: UNINITIALIZED for 2s [ 898.935090] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.935090] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.935090] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.935090] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.935090] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.968527] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8f01fd17-613c-4bd7-9c6b-8b39ac58be72 in Status: IN_PROGRESS for 2s [ 899.209583] env[69188]: INFO networking_nsxv3.common.synchronization [None req-11c9c090-b3ea-43cc-8d05-a6fb93fd64ef tempest-ServerActionsTestJSON-1027345226 tempest-ServerActionsTestJSON-1027345226-project-member] Enqueued Resource ID: 725df672-6688-4714-8676-49fbb42ed7bd with Priority: HIGHEST for action security_group_rules [ 899.210212] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 725df672-6688-4714-8676-49fbb42ed7bd with Priority: HIGHEST for action security_group_rules [ 899.210646] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-725df672-6688-4714-8676-49fbb42ed7bd taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.210824] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-725df672-6688-4714-8676-49fbb42ed7bd" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.210900] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-725df672-6688-4714-8676-49fbb42ed7bd" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.212186] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-725df672-6688-4714-8676-49fbb42ed7bd" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.212257] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('725df672-6688-4714-8676-49fbb42ed7bd',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.342658] env[69188]: INFO networking_nsxv3.common.synchronization [None req-6a6632cc-200b-4dc8-93a6-4d350a1f1796 tempest-ServerActionsTestJSON-1027345226 tempest-ServerActionsTestJSON-1027345226-project-member] Enqueued Resource ID: 725df672-6688-4714-8676-49fbb42ed7bd with Priority: HIGHEST for action security_group_rules [ 899.343237] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 725df672-6688-4714-8676-49fbb42ed7bd with Priority: HIGHEST for action security_group_rules [ 899.343237] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-725df672-6688-4714-8676-49fbb42ed7bd taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.343338] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-725df672-6688-4714-8676-49fbb42ed7bd" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.624160] env[69188]: INFO networking_nsxv3.common.synchronization [req-1dc833d6-e4a6-4c70-b20e-127ab33b96d5 req-7a7a1b64-07f1-421e-bcce-ed86e2f0e084 service nova] Enqueued Resource ID: d7156740-676b-417b-9850-f10d741c20bd with Priority: HIGHEST for action security_group_rules [ 899.624432] env[69188]: INFO networking_nsxv3.common.synchronization [req-1dc833d6-e4a6-4c70-b20e-127ab33b96d5 req-7a7a1b64-07f1-421e-bcce-ed86e2f0e084 service nova] Enqueued Resource ID: d7156740-676b-417b-9850-f10d741c20bd with Priority: HIGHEST for action security_group_members [ 899.624583] env[69188]: INFO networking_nsxv3.common.synchronization [req-1dc833d6-e4a6-4c70-b20e-127ab33b96d5 req-7a7a1b64-07f1-421e-bcce-ed86e2f0e084 service nova] Enqueued Resource ID: 78d72166-f709-4942-8bab-fa2e56972ab0 with Priority: HIGHEST for action port [ 899.625292] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d7156740-676b-417b-9850-f10d741c20bd with Priority: HIGHEST for action security_group_rules [ 899.626137] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d7156740-676b-417b-9850-f10d741c20bd with Priority: HIGHEST for action security_group_members [ 899.626305] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78d72166-f709-4942-8bab-fa2e56972ab0 with Priority: HIGHEST for action port [ 899.626871] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d7156740-676b-417b-9850-f10d741c20bd taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.627048] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d7156740-676b-417b-9850-f10d741c20bd" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.630823] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-d7156740-676b-417b-9850-f10d741c20bd taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.630823] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d7156740-676b-417b-9850-f10d741c20bd" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.630823] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-78d72166-f709-4942-8bab-fa2e56972ab0 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.630823] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-78d72166-f709-4942-8bab-fa2e56972ab0" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.630823] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-78d72166-f709-4942-8bab-fa2e56972ab0" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.630823] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-78d72166-f709-4942-8bab-fa2e56972ab0" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.630823] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('78d72166-f709-4942-8bab-fa2e56972ab0',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.738988] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.739167] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.739167] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.739988] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.739988] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.739988] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 725df672-6688-4714-8676-49fbb42ed7bd already deleted. [ 899.739988] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-725df672-6688-4714-8676-49fbb42ed7bd" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.739988] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-725df672-6688-4714-8676-49fbb42ed7bd" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.739988] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-725df672-6688-4714-8676-49fbb42ed7bd" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.740303] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('725df672-6688-4714-8676-49fbb42ed7bd',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.896828] env[69188]: INFO networking_nsxv3.common.synchronization [req-cc965843-f9cc-4724-adb1-c82b923bd213 req-3fd5f93b-9340-4aad-bdcc-c8ac66467211 service nova] Enqueued Resource ID: 24a7b083-b432-46d6-94de-76adf6ce22b3 with Priority: HIGHEST for action security_group_rules [ 899.897132] env[69188]: INFO networking_nsxv3.common.synchronization [req-cc965843-f9cc-4724-adb1-c82b923bd213 req-3fd5f93b-9340-4aad-bdcc-c8ac66467211 service nova] Enqueued Resource ID: 24a7b083-b432-46d6-94de-76adf6ce22b3 with Priority: HIGHEST for action security_group_members [ 899.897173] env[69188]: INFO networking_nsxv3.common.synchronization [req-cc965843-f9cc-4724-adb1-c82b923bd213 req-3fd5f93b-9340-4aad-bdcc-c8ac66467211 service nova] Enqueued Resource ID: 1b20cb32-97a6-4504-acc5-8aab27acc59d with Priority: HIGHEST for action port [ 899.897373] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 24a7b083-b432-46d6-94de-76adf6ce22b3 with Priority: HIGHEST for action security_group_rules [ 899.897496] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 24a7b083-b432-46d6-94de-76adf6ce22b3 with Priority: HIGHEST for action security_group_members [ 899.897663] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1b20cb32-97a6-4504-acc5-8aab27acc59d with Priority: HIGHEST for action port [ 899.899022] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-24a7b083-b432-46d6-94de-76adf6ce22b3 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.899022] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-24a7b083-b432-46d6-94de-76adf6ce22b3" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.899022] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-24a7b083-b432-46d6-94de-76adf6ce22b3" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.899022] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-24a7b083-b432-46d6-94de-76adf6ce22b3" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.899022] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('24a7b083-b432-46d6-94de-76adf6ce22b3',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.899849] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-24a7b083-b432-46d6-94de-76adf6ce22b3 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.899946] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-24a7b083-b432-46d6-94de-76adf6ce22b3" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.900432] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-1b20cb32-97a6-4504-acc5-8aab27acc59d taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.900432] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1b20cb32-97a6-4504-acc5-8aab27acc59d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.900432] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1b20cb32-97a6-4504-acc5-8aab27acc59d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.900585] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1b20cb32-97a6-4504-acc5-8aab27acc59d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.900585] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1b20cb32-97a6-4504-acc5-8aab27acc59d',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.130432] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 78d72166-f709-4942-8bab-fa2e56972ab0 with status ACTIVE [ 900.130977] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.130977] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.130977] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.131174] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.131420] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.131420] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.131523] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.131565] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.131969] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.131969] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.132082] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.132082] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.132175] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.132667] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.132667] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.132667] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 78d72166-f709-4942-8bab-fa2e56972ab0 is going to be updated. [ 900.152129] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.152294] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.152352] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.152560] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.152696] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.152852] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-78d72166-f709-4942-8bab-fa2e56972ab0" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.261439] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.261439] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.261439] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.261689] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.261724] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.261857] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 725df672-6688-4714-8676-49fbb42ed7bd already deleted. [ 900.261908] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-725df672-6688-4714-8676-49fbb42ed7bd" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.345291] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 24a7b083-b432-46d6-94de-76adf6ce22b3 in Status: SUCCESS [ 900.345534] env[69188]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 24a7b083-b432-46d6-94de-76adf6ce22b3 deletion is rescheduled due to dependency. [ 900.345627] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-24a7b083-b432-46d6-94de-76adf6ce22b3" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.345749] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-24a7b083-b432-46d6-94de-76adf6ce22b3" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.345983] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-24a7b083-b432-46d6-94de-76adf6ce22b3" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.346185] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.346321] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.346360] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.346509] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.348104] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.348196] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('24a7b083-b432-46d6-94de-76adf6ce22b3',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.402872] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-24a7b083-b432-46d6-94de-76adf6ce22b3 taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.403078] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-24a7b083-b432-46d6-94de-76adf6ce22b3" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.403713] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1b20cb32-97a6-4504-acc5-8aab27acc59d with status ACTIVE [ 900.403713] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.403713] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.403713] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.403713] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.404103] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.404103] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.404103] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.404103] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.404340] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.404340] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.404510] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.404614] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.404673] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.404821] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.404895] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.405009] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1b20cb32-97a6-4504-acc5-8aab27acc59d is going to be updated. [ 900.423141] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.423340] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.423424] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.423671] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.423839] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.424251] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1b20cb32-97a6-4504-acc5-8aab27acc59d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.852370] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('24a7b083-b432-46d6-94de-76adf6ce22b3',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.917751] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d7156740-676b-417b-9850-f10d741c20bd in Status: SUCCESS [ 900.918078] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d7156740-676b-417b-9850-f10d741c20bd" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.918078] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d7156740-676b-417b-9850-f10d741c20bd" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.918773] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d7156740-676b-417b-9850-f10d741c20bd" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.918773] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.918773] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.918773] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.918993] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.918993] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.919075] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d7156740-676b-417b-9850-f10d741c20bd" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.919175] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d7156740-676b-417b-9850-f10d741c20bd',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.920150] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d7156740-676b-417b-9850-f10d741c20bd" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.920328] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d7156740-676b-417b-9850-f10d741c20bd" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.921419] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.921419] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.921419] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.921419] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.921419] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.921419] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d7156740-676b-417b-9850-f10d741c20bd',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.980707] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8f01fd17-613c-4bd7-9c6b-8b39ac58be72 in Status: SUCCESS [ 900.980942] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8f01fd17-613c-4bd7-9c6b-8b39ac58be72" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.357137] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('24a7b083-b432-46d6-94de-76adf6ce22b3',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.427023] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-d7156740-676b-417b-9850-f10d741c20bd taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.427023] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d7156740-676b-417b-9850-f10d741c20bd" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.428442] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d7156740-676b-417b-9850-f10d741c20bd',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.860623] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.860623] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.860947] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.860947] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.861043] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.861122] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 24a7b083-b432-46d6-94de-76adf6ce22b3 is going to be updated. [ 901.892431] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.893557] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.893557] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.893557] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.893557] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.907158] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 24a7b083-b432-46d6-94de-76adf6ce22b3 in Status: IN_PROGRESS for 2s [ 901.932981] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d7156740-676b-417b-9850-f10d741c20bd',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.434124] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.434300] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.434376] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.434590] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.434698] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.434815] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d7156740-676b-417b-9850-f10d741c20bd is going to be updated. [ 902.462836] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.463058] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.463171] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.463564] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.463836] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.476286] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d7156740-676b-417b-9850-f10d741c20bd in Status: IN_PROGRESS for 2s [ 903.916012] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 24a7b083-b432-46d6-94de-76adf6ce22b3 in Status: SUCCESS [ 903.916285] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-24a7b083-b432-46d6-94de-76adf6ce22b3" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.916487] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-24a7b083-b432-46d6-94de-76adf6ce22b3" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.916764] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-24a7b083-b432-46d6-94de-76adf6ce22b3" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.917025] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.917194] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.917286] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.918507] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.918507] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.918507] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-24a7b083-b432-46d6-94de-76adf6ce22b3" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.918507] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('24a7b083-b432-46d6-94de-76adf6ce22b3',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.419753] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-24a7b083-b432-46d6-94de-76adf6ce22b3 taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.419970] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-24a7b083-b432-46d6-94de-76adf6ce22b3" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.419970] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-24a7b083-b432-46d6-94de-76adf6ce22b3" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.420196] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-24a7b083-b432-46d6-94de-76adf6ce22b3" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.420434] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.420434] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.420570] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.420667] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.420788] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.420891] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-24a7b083-b432-46d6-94de-76adf6ce22b3" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.421273] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-24a7b083-b432-46d6-94de-76adf6ce22b3 taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.421273] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-24a7b083-b432-46d6-94de-76adf6ce22b3" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.421273] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-24a7b083-b432-46d6-94de-76adf6ce22b3" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.421600] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-24a7b083-b432-46d6-94de-76adf6ce22b3" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.421600] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.421600] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.421754] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.421869] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.421915] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.422040] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-24a7b083-b432-46d6-94de-76adf6ce22b3" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.422210] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('24a7b083-b432-46d6-94de-76adf6ce22b3',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.485570] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d7156740-676b-417b-9850-f10d741c20bd in Status: SUCCESS [ 904.485801] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d7156740-676b-417b-9850-f10d741c20bd" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.485963] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d7156740-676b-417b-9850-f10d741c20bd" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.486238] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d7156740-676b-417b-9850-f10d741c20bd" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.486425] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.486549] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.486617] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.486778] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.486856] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.486948] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d7156740-676b-417b-9850-f10d741c20bd" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.487117] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-d7156740-676b-417b-9850-f10d741c20bd taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.487233] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d7156740-676b-417b-9850-f10d741c20bd" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.487301] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d7156740-676b-417b-9850-f10d741c20bd" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.487395] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d7156740-676b-417b-9850-f10d741c20bd" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.487534] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.487624] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.487682] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.487819] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.487896] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.487981] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d7156740-676b-417b-9850-f10d741c20bd" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.488087] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d7156740-676b-417b-9850-f10d741c20bd',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.898891] env[69188]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 904.899076] env[69188]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=3 [ 904.926496] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 24a7b083-b432-46d6-94de-76adf6ce22b3: rpc.has_security_group_logging(os_id): False [ 904.942608] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.942789] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.942856] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.943059] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.943672] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.943672] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.943672] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.943672] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.943672] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.944366] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.944366] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.944366] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.944366] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.944366] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.944366] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.945155] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.945155] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.945155] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.945155] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.945155] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.945155] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 24a7b083-b432-46d6-94de-76adf6ce22b3 is going to be updated. [ 904.993365] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d7156740-676b-417b-9850-f10d741c20bd: rpc.has_security_group_logging(os_id): False [ 905.022883] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.022883] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.022883] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.022883] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.022883] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.023206] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.023206] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.023206] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.023348] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.024038] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.024038] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.024038] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.024038] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.024038] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.025250] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.025569] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.025707] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.025797] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.026342] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.026507] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.026607] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d7156740-676b-417b-9850-f10d741c20bd is going to be created. [ 905.028875] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.029025] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.029128] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.029329] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.029549] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.042824] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 24a7b083-b432-46d6-94de-76adf6ce22b3 in Status: IN_PROGRESS for 2s [ 905.128956] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.129204] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.129253] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.129622] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.129818] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.148785] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d7156740-676b-417b-9850-f10d741c20bd in Status: IN_PROGRESS for 2s [ 907.058103] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 24a7b083-b432-46d6-94de-76adf6ce22b3 in Status: SUCCESS [ 907.058103] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-24a7b083-b432-46d6-94de-76adf6ce22b3" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.166041] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d7156740-676b-417b-9850-f10d741c20bd in Status: SUCCESS [ 907.166041] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d7156740-676b-417b-9850-f10d741c20bd" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.166041] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d7156740-676b-417b-9850-f10d741c20bd" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.166041] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d7156740-676b-417b-9850-f10d741c20bd" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.166041] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d7156740-676b-417b-9850-f10d741c20bd',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 907.670279] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-d7156740-676b-417b-9850-f10d741c20bd taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.670279] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d7156740-676b-417b-9850-f10d741c20bd" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.670279] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d7156740-676b-417b-9850-f10d741c20bd" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.670279] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d7156740-676b-417b-9850-f10d741c20bd" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.670279] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.670279] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.670279] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.670279] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.670279] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.670279] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d7156740-676b-417b-9850-f10d741c20bd" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.670279] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d7156740-676b-417b-9850-f10d741c20bd',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.172886] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-d7156740-676b-417b-9850-f10d741c20bd taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.173269] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d7156740-676b-417b-9850-f10d741c20bd" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.173269] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d7156740-676b-417b-9850-f10d741c20bd" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.173415] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d7156740-676b-417b-9850-f10d741c20bd" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.173604] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.173730] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.173808] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.174036] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.174130] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.174232] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d7156740-676b-417b-9850-f10d741c20bd" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.174382] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-d7156740-676b-417b-9850-f10d741c20bd taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.174475] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d7156740-676b-417b-9850-f10d741c20bd" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.174547] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d7156740-676b-417b-9850-f10d741c20bd" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.174763] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d7156740-676b-417b-9850-f10d741c20bd" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.174914] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.175013] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.175080] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.175219] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.175348] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.175451] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d7156740-676b-417b-9850-f10d741c20bd" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.175546] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d7156740-676b-417b-9850-f10d741c20bd',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.678454] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d7156740-676b-417b-9850-f10d741c20bd: rpc.has_security_group_logging(os_id): False [ 908.698043] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.698229] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.698267] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.698646] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.698826] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.699106] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.699226] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.699347] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.699605] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.699719] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.699983] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.700118] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.700175] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.700379] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.700459] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.701031] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.701031] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.701031] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.701223] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.701223] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.701223] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d7156740-676b-417b-9850-f10d741c20bd is going to be updated. [ 908.757429] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.757611] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.757741] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.758843] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.758843] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.772901] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d7156740-676b-417b-9850-f10d741c20bd in Status: IN_PROGRESS for 2s [ 909.900133] env[69188]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 909.900397] env[69188]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 910.793808] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d7156740-676b-417b-9850-f10d741c20bd in Status: SUCCESS [ 910.794085] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d7156740-676b-417b-9850-f10d741c20bd" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.435519] env[69188]: INFO networking_nsxv3.common.synchronization [req-885f458b-d741-4c87-b64a-ac7c0271423c req-7394a668-6ea4-4400-88a3-1f9e185516b5 tempest-ServersTestMultiNic-1128640872 tempest-ServersTestMultiNic-1128640872-project-member] Enqueued Resource ID: d7156740-676b-417b-9850-f10d741c20bd with Priority: HIGHEST for action security_group_members [ 914.436055] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d7156740-676b-417b-9850-f10d741c20bd with Priority: HIGHEST for action security_group_members [ 914.436370] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-d7156740-676b-417b-9850-f10d741c20bd taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.436532] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d7156740-676b-417b-9850-f10d741c20bd" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.436610] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d7156740-676b-417b-9850-f10d741c20bd" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.436810] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d7156740-676b-417b-9850-f10d741c20bd" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.436970] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.439308] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.439308] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.439522] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.439666] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.439797] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d7156740-676b-417b-9850-f10d741c20bd',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 914.785979] env[69188]: INFO networking_nsxv3.common.synchronization [req-885f458b-d741-4c87-b64a-ac7c0271423c req-6f5db058-4487-45e6-b563-609a40a9a4da tempest-ServersTestMultiNic-1128640872 tempest-ServersTestMultiNic-1128640872-project-member] Enqueued Resource ID: d7156740-676b-417b-9850-f10d741c20bd with Priority: HIGHEST for action security_group_members [ 914.786550] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d7156740-676b-417b-9850-f10d741c20bd with Priority: HIGHEST for action security_group_members [ 914.786859] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-d7156740-676b-417b-9850-f10d741c20bd taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.786968] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d7156740-676b-417b-9850-f10d741c20bd" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.942067] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d7156740-676b-417b-9850-f10d741c20bd',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.444732] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d7156740-676b-417b-9850-f10d741c20bd',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.872053] env[69188]: INFO networking_nsxv3.common.synchronization [req-5505bb06-71af-4521-a028-2fc0267757cd req-cadc2db6-944a-4efa-9a16-01812508ddf0 tempest-ImagesTestJSON-2034330654 tempest-ImagesTestJSON-2034330654-project-member] Enqueued Resource ID: 199db626-eef5-4a20-b92a-585841c1cff4 with Priority: HIGHEST for action security_group_members [ 915.872626] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 199db626-eef5-4a20-b92a-585841c1cff4 with Priority: HIGHEST for action security_group_members [ 915.873381] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-199db626-eef5-4a20-b92a-585841c1cff4 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.875119] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-199db626-eef5-4a20-b92a-585841c1cff4" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.875217] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-199db626-eef5-4a20-b92a-585841c1cff4" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.876021] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-199db626-eef5-4a20-b92a-585841c1cff4" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.876021] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.876021] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.876021] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.876021] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.876431] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.876431] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('199db626-eef5-4a20-b92a-585841c1cff4',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.954228] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.954406] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.954460] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.954805] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.954805] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.954933] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d7156740-676b-417b-9850-f10d741c20bd is going to be updated. [ 915.980388] env[69188]: INFO networking_nsxv3.common.synchronization [None req-277a23fb-eed6-452a-851c-67ca30f3d070 None None] Enqueued Resource ID: 04082a42-843d-4ae2-98d7-929e6f6a6201 with Priority: HIGHEST for action port [ 915.981602] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.981798] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.981863] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.983205] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.983205] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.983737] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 04082a42-843d-4ae2-98d7-929e6f6a6201 with Priority: HIGHEST for action port [ 915.984124] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-04082a42-843d-4ae2-98d7-929e6f6a6201 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.984249] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-04082a42-843d-4ae2-98d7-929e6f6a6201" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.984322] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-04082a42-843d-4ae2-98d7-929e6f6a6201" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.984570] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-04082a42-843d-4ae2-98d7-929e6f6a6201" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.984665] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('04082a42-843d-4ae2-98d7-929e6f6a6201',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.995053] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d7156740-676b-417b-9850-f10d741c20bd in Status: IN_PROGRESS for 2s [ 916.383183] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.383412] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.383412] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.383552] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.383651] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.383900] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.384058] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.384137] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.384327] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.384408] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.384514] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 199db626-eef5-4a20-b92a-585841c1cff4 is going to be updated. [ 916.411441] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.411597] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.411671] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.411881] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.412034] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.422731] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 199db626-eef5-4a20-b92a-585841c1cff4 in Status: IN_PROGRESS for 2s [ 916.491199] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 04082a42-843d-4ae2-98d7-929e6f6a6201 [ 916.491199] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.491199] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.491199] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.491199] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.491199] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.491642] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:04082a42-843d-4ae2-98d7-929e6f6a6201 already deleted. [ 916.491642] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-04082a42-843d-4ae2-98d7-929e6f6a6201" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.961404] env[69188]: INFO networking_nsxv3.common.synchronization [None req-fc9498fb-0bf9-4ddd-b04e-ba70bfb492ae None None] Enqueued Resource ID: e32ff3ee-7433-4557-97ae-c2da4476be42 with Priority: HIGHEST for action port [ 917.965734] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e32ff3ee-7433-4557-97ae-c2da4476be42 with Priority: HIGHEST for action port [ 917.967778] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-e32ff3ee-7433-4557-97ae-c2da4476be42 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.967778] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e32ff3ee-7433-4557-97ae-c2da4476be42" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.967778] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e32ff3ee-7433-4557-97ae-c2da4476be42" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.967778] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e32ff3ee-7433-4557-97ae-c2da4476be42" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.967778] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e32ff3ee-7433-4557-97ae-c2da4476be42',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.005480] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d7156740-676b-417b-9850-f10d741c20bd in Status: SUCCESS [ 918.005640] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d7156740-676b-417b-9850-f10d741c20bd" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.005803] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d7156740-676b-417b-9850-f10d741c20bd" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.006024] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d7156740-676b-417b-9850-f10d741c20bd" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.006312] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.006404] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.006404] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.006579] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.006667] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.007262] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d7156740-676b-417b-9850-f10d741c20bd',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.432257] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 199db626-eef5-4a20-b92a-585841c1cff4 in Status: SUCCESS [ 918.436278] env[69188]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 199db626-eef5-4a20-b92a-585841c1cff4 deletion is rescheduled due to dependency. [ 918.436414] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-199db626-eef5-4a20-b92a-585841c1cff4" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.472636] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e32ff3ee-7433-4557-97ae-c2da4476be42 [ 918.472636] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.472636] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.473048] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.473048] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.473196] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.474341] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e32ff3ee-7433-4557-97ae-c2da4476be42 already deleted. [ 918.474341] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e32ff3ee-7433-4557-97ae-c2da4476be42" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.511692] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.511930] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.512048] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.512346] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.512497] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.512792] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.512949] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.513062] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.513413] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.513481] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.513580] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d7156740-676b-417b-9850-f10d741c20bd is going to be updated. [ 918.541976] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.542212] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.542373] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.542630] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.542845] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.557297] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d7156740-676b-417b-9850-f10d741c20bd in Status: IN_PROGRESS for 2s [ 918.564378] env[69188]: INFO networking_nsxv3.common.synchronization [req-269f63e2-2910-4aa7-9ea8-326d184a360e req-c5aee117-d7a2-46f7-8b43-4c6b546d3851 tempest-ImagesOneServerNegativeTestJSON-1186419322 tempest-ImagesOneServerNegativeTestJSON-1186419322-project-member] Enqueued Resource ID: 9d153fe4-605f-47fe-a33b-9d019b977fa7 with Priority: HIGHEST for action security_group_members [ 918.566990] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9d153fe4-605f-47fe-a33b-9d019b977fa7 with Priority: HIGHEST for action security_group_members [ 918.568951] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-9d153fe4-605f-47fe-a33b-9d019b977fa7 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.569191] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9d153fe4-605f-47fe-a33b-9d019b977fa7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.569290] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9d153fe4-605f-47fe-a33b-9d019b977fa7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.569558] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9d153fe4-605f-47fe-a33b-9d019b977fa7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.569789] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.569903] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.569958] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.570144] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.570235] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.570619] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9d153fe4-605f-47fe-a33b-9d019b977fa7',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.072718] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.072988] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.072988] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.074270] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.074270] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.074270] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.074270] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.074270] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.074270] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.074270] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.074270] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9d153fe4-605f-47fe-a33b-9d019b977fa7 is going to be updated. [ 919.098388] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.098388] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.098388] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.098388] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.098626] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.109097] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9d153fe4-605f-47fe-a33b-9d019b977fa7 in Status: IN_PROGRESS for 2s [ 919.389875] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock network-791 taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.390146] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "network-791" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.390227] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "network-791" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.390506] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "network-791" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.390767] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.390909] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.392316] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.392772] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.392872] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.393213] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 919.393479] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] NeedRegenerationException {{(pid=69188) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 919.393694] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] no value, waiting for create lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 919.393902] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] value creation lock acquired {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 919.394138] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 919.394553] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Calling creation function for not-yet-present value {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 919.394633] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 919.426801] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 919.427010] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Cache value generated in 0.032 seconds for key(s): 'zone-id' {{(pid=69188) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 919.427592] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Released creation lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 919.427592] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "network-791" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.427963] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock port-a05f3e90-78f0-4ebd-8004-622438b75eeb taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.431020] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "port-a05f3e90-78f0-4ebd-8004-622438b75eeb" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.431020] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "port-a05f3e90-78f0-4ebd-8004-622438b75eeb" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.431020] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "port-a05f3e90-78f0-4ebd-8004-622438b75eeb" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.431020] env[69188]: DEBUG networking_nsxv3.api.rpc [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a05f3e90-78f0-4ebd-8004-622438b75eeb',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.488027] env[69188]: INFO networking_nsxv3.common.synchronization [req-d45c4aec-8d55-486c-b18a-60858c63ddff req-f0510595-4955-49c9-8117-7d73d9daf28f tempest-ListImageFiltersTestJSON-1208479351 tempest-ListImageFiltersTestJSON-1208479351-project-member] Enqueued Resource ID: e6233127-d754-46c4-9840-1e77714a63d1 with Priority: HIGHEST for action security_group_members [ 919.488027] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e6233127-d754-46c4-9840-1e77714a63d1 with Priority: HIGHEST for action security_group_members [ 919.488027] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-e6233127-d754-46c4-9840-1e77714a63d1 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.488027] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e6233127-d754-46c4-9840-1e77714a63d1" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.488027] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e6233127-d754-46c4-9840-1e77714a63d1" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.488425] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e6233127-d754-46c4-9840-1e77714a63d1" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.488425] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.488551] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.488596] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.489530] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.489530] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.489530] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e6233127-d754-46c4-9840-1e77714a63d1',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.932858] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.933159] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.933295] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.933607] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.933801] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.934097] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Segment Port a05f3e90-78f0-4ebd-8004-622438b75eeb not found, creating... [ 919.934435] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.934435] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.934631] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.934890] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.934967] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.935264] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.935424] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.935552] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.935872] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.936751] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.937140] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Resource: SegmentPort with ID: a05f3e90-78f0-4ebd-8004-622438b75eeb is going to be created. [ 919.957390] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.957722] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.957851] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.958294] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.958691] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.959072] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "port-a05f3e90-78f0-4ebd-8004-622438b75eeb" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.991333] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e6233127-d754-46c4-9840-1e77714a63d1',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 920.495028] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e6233127-d754-46c4-9840-1e77714a63d1',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 920.566198] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d7156740-676b-417b-9850-f10d741c20bd in Status: SUCCESS [ 920.566739] env[69188]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d7156740-676b-417b-9850-f10d741c20bd deletion is rescheduled due to dependency. [ 920.566739] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d7156740-676b-417b-9850-f10d741c20bd" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.773378] env[69188]: INFO networking_nsxv3.common.synchronization [req-269f63e2-2910-4aa7-9ea8-326d184a360e req-b917cb7c-cb4b-4699-9906-4fa5702ed162 service nova] Enqueued Resource ID: 9d153fe4-605f-47fe-a33b-9d019b977fa7 with Priority: HIGHEST for action security_group_rules [ 920.773378] env[69188]: INFO networking_nsxv3.common.synchronization [req-269f63e2-2910-4aa7-9ea8-326d184a360e req-b917cb7c-cb4b-4699-9906-4fa5702ed162 service nova] Enqueued Resource ID: 9d153fe4-605f-47fe-a33b-9d019b977fa7 with Priority: HIGHEST for action security_group_members [ 920.773378] env[69188]: INFO networking_nsxv3.common.synchronization [req-269f63e2-2910-4aa7-9ea8-326d184a360e req-b917cb7c-cb4b-4699-9906-4fa5702ed162 service nova] Enqueued Resource ID: a05f3e90-78f0-4ebd-8004-622438b75eeb with Priority: HIGHEST for action port [ 920.773378] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9d153fe4-605f-47fe-a33b-9d019b977fa7 with Priority: HIGHEST for action security_group_rules [ 920.773843] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9d153fe4-605f-47fe-a33b-9d019b977fa7 with Priority: HIGHEST for action security_group_members [ 920.774302] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a05f3e90-78f0-4ebd-8004-622438b75eeb with Priority: HIGHEST for action port [ 920.774736] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9d153fe4-605f-47fe-a33b-9d019b977fa7 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.775677] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9d153fe4-605f-47fe-a33b-9d019b977fa7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.775761] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9d153fe4-605f-47fe-a33b-9d019b977fa7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.776025] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9d153fe4-605f-47fe-a33b-9d019b977fa7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.776139] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9d153fe4-605f-47fe-a33b-9d019b977fa7',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 920.777175] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-9d153fe4-605f-47fe-a33b-9d019b977fa7 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.777277] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9d153fe4-605f-47fe-a33b-9d019b977fa7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.779954] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-a05f3e90-78f0-4ebd-8004-622438b75eeb taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.779954] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a05f3e90-78f0-4ebd-8004-622438b75eeb" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.779954] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a05f3e90-78f0-4ebd-8004-622438b75eeb" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.779954] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a05f3e90-78f0-4ebd-8004-622438b75eeb" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.779954] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a05f3e90-78f0-4ebd-8004-622438b75eeb',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 920.997155] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.997384] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.997493] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.997801] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.997937] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.998112] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e6233127-d754-46c4-9840-1e77714a63d1 is going to be updated. [ 921.029353] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.029353] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.029353] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.029353] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.029353] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.038048] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e6233127-d754-46c4-9840-1e77714a63d1 in Status: IN_PROGRESS for 2s [ 921.118374] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9d153fe4-605f-47fe-a33b-9d019b977fa7 in Status: SUCCESS [ 921.118683] env[69188]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9d153fe4-605f-47fe-a33b-9d019b977fa7 deletion is rescheduled due to dependency. [ 921.118764] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9d153fe4-605f-47fe-a33b-9d019b977fa7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.119399] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9d153fe4-605f-47fe-a33b-9d019b977fa7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.119637] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9d153fe4-605f-47fe-a33b-9d019b977fa7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.119857] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.120034] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.120109] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.120272] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.120487] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.120487] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9d153fe4-605f-47fe-a33b-9d019b977fa7',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 921.280838] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-9d153fe4-605f-47fe-a33b-9d019b977fa7 taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.280838] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9d153fe4-605f-47fe-a33b-9d019b977fa7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.280838] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a05f3e90-78f0-4ebd-8004-622438b75eeb with status ACTIVE [ 921.280838] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.280838] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.281265] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.281574] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.281678] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.281868] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.282011] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.282075] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.282230] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.282312] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.282508] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.282647] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.282745] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.282904] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.282982] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.287326] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a05f3e90-78f0-4ebd-8004-622438b75eeb is going to be updated. [ 921.307084] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.307424] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.307424] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.307581] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.307748] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.307912] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a05f3e90-78f0-4ebd-8004-622438b75eeb" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.530555] env[69188]: INFO networking_nsxv3.common.synchronization [req-c5901254-a3f2-4cd2-846e-6f38f8f9bfc8 req-855a4c92-8c6b-4810-8b92-dc772ed4cd89 tempest-SecurityGroupsTestJSON-1621209229 tempest-SecurityGroupsTestJSON-1621209229-project-member] Enqueued Resource ID: b99e414b-ff9c-4d19-b3c8-32ab58288d75 with Priority: HIGHEST for action security_group_members [ 921.532307] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b99e414b-ff9c-4d19-b3c8-32ab58288d75 with Priority: HIGHEST for action security_group_members [ 921.533264] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-b99e414b-ff9c-4d19-b3c8-32ab58288d75 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.533264] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b99e414b-ff9c-4d19-b3c8-32ab58288d75" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.533264] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b99e414b-ff9c-4d19-b3c8-32ab58288d75" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.533264] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b99e414b-ff9c-4d19-b3c8-32ab58288d75" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.533264] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.533620] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.533620] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.533715] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.534109] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.534261] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b99e414b-ff9c-4d19-b3c8-32ab58288d75',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 921.624325] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9d153fe4-605f-47fe-a33b-9d019b977fa7',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 921.941906] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock network-88 taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.942136] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "network-88" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.942272] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "network-88" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.942555] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "network-88" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.942825] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.942996] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.944391] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.944802] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.944982] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.945300] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 921.945451] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] NeedRegenerationException {{(pid=69188) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 921.945687] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] no value, waiting for create lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 921.945857] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] value creation lock acquired {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 921.946019] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 921.946237] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Calling creation function for not-yet-present value {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 921.946364] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 921.968838] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 921.969074] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=69188) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 921.969245] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Released creation lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 921.969503] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "network-88" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.969968] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock port-bf835081-b81d-435a-95c8-cc555e6e5bf8 taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.970121] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "port-bf835081-b81d-435a-95c8-cc555e6e5bf8" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.970256] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "port-bf835081-b81d-435a-95c8-cc555e6e5bf8" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.970608] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "port-bf835081-b81d-435a-95c8-cc555e6e5bf8" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.970756] env[69188]: DEBUG networking_nsxv3.api.rpc [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bf835081-b81d-435a-95c8-cc555e6e5bf8',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.037276] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b99e414b-ff9c-4d19-b3c8-32ab58288d75',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.128365] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9d153fe4-605f-47fe-a33b-9d019b977fa7',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.476023] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.476023] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.476023] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.476023] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.476023] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.476023] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Segment Port bf835081-b81d-435a-95c8-cc555e6e5bf8 not found, creating... [ 922.476023] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.476023] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.476023] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.476023] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.476023] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.476540] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.476540] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.476540] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.477431] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.477699] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.477940] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Resource: SegmentPort with ID: bf835081-b81d-435a-95c8-cc555e6e5bf8 is going to be created. [ 922.497727] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.497727] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.497727] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.500778] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.500778] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.500778] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "port-bf835081-b81d-435a-95c8-cc555e6e5bf8" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.539674] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b99e414b-ff9c-4d19-b3c8-32ab58288d75',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.631568] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.631752] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.631799] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.631984] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.632091] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.632190] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9d153fe4-605f-47fe-a33b-9d019b977fa7 is going to be updated. [ 922.671514] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.671696] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.671737] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.672142] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.672330] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.683118] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9d153fe4-605f-47fe-a33b-9d019b977fa7 in Status: IN_PROGRESS for 2s [ 923.042309] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.042465] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.042542] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.042846] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.042986] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.043121] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b99e414b-ff9c-4d19-b3c8-32ab58288d75 is going to be updated. [ 923.051929] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e6233127-d754-46c4-9840-1e77714a63d1 in Status: SUCCESS [ 923.052244] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e6233127-d754-46c4-9840-1e77714a63d1" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.068137] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.068339] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.068467] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.068729] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.070958] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.077119] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b99e414b-ff9c-4d19-b3c8-32ab58288d75 in Status: IN_PROGRESS for 2s [ 923.723570] env[69188]: INFO networking_nsxv3.common.synchronization [req-c5901254-a3f2-4cd2-846e-6f38f8f9bfc8 req-137bf5e1-326a-444f-9f35-32a023bc8713 service nova] Enqueued Resource ID: b99e414b-ff9c-4d19-b3c8-32ab58288d75 with Priority: HIGHEST for action security_group_rules [ 923.724459] env[69188]: INFO networking_nsxv3.common.synchronization [req-c5901254-a3f2-4cd2-846e-6f38f8f9bfc8 req-137bf5e1-326a-444f-9f35-32a023bc8713 service nova] Enqueued Resource ID: b99e414b-ff9c-4d19-b3c8-32ab58288d75 with Priority: HIGHEST for action security_group_members [ 923.724459] env[69188]: INFO networking_nsxv3.common.synchronization [req-c5901254-a3f2-4cd2-846e-6f38f8f9bfc8 req-137bf5e1-326a-444f-9f35-32a023bc8713 service nova] Enqueued Resource ID: bf835081-b81d-435a-95c8-cc555e6e5bf8 with Priority: HIGHEST for action port [ 923.725585] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b99e414b-ff9c-4d19-b3c8-32ab58288d75 with Priority: HIGHEST for action security_group_rules [ 923.725585] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b99e414b-ff9c-4d19-b3c8-32ab58288d75 with Priority: HIGHEST for action security_group_members [ 923.725585] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bf835081-b81d-435a-95c8-cc555e6e5bf8 with Priority: HIGHEST for action port [ 923.725964] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b99e414b-ff9c-4d19-b3c8-32ab58288d75 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.726315] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b99e414b-ff9c-4d19-b3c8-32ab58288d75" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.726632] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b99e414b-ff9c-4d19-b3c8-32ab58288d75" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.726858] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b99e414b-ff9c-4d19-b3c8-32ab58288d75" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.726940] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b99e414b-ff9c-4d19-b3c8-32ab58288d75',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 923.728249] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-b99e414b-ff9c-4d19-b3c8-32ab58288d75 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.728249] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b99e414b-ff9c-4d19-b3c8-32ab58288d75" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.728948] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-bf835081-b81d-435a-95c8-cc555e6e5bf8 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.728948] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bf835081-b81d-435a-95c8-cc555e6e5bf8" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.728948] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bf835081-b81d-435a-95c8-cc555e6e5bf8" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.728948] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bf835081-b81d-435a-95c8-cc555e6e5bf8" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.728948] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bf835081-b81d-435a-95c8-cc555e6e5bf8',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 924.234507] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-b99e414b-ff9c-4d19-b3c8-32ab58288d75 taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.234643] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b99e414b-ff9c-4d19-b3c8-32ab58288d75" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.234842] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bf835081-b81d-435a-95c8-cc555e6e5bf8 with status ACTIVE [ 924.235089] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.235175] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.235267] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.236069] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.236069] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.236069] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.236069] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.236069] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.236069] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.236069] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.236362] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.236362] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.236429] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.236568] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.236656] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.236778] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bf835081-b81d-435a-95c8-cc555e6e5bf8 is going to be updated. [ 924.257849] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.258015] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.258093] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.258435] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.258435] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.258624] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bf835081-b81d-435a-95c8-cc555e6e5bf8" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.692776] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9d153fe4-605f-47fe-a33b-9d019b977fa7 in Status: SUCCESS [ 924.692776] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9d153fe4-605f-47fe-a33b-9d019b977fa7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.692776] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9d153fe4-605f-47fe-a33b-9d019b977fa7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.692776] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9d153fe4-605f-47fe-a33b-9d019b977fa7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.692776] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.693037] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.693037] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.693140] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.693140] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.693227] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9d153fe4-605f-47fe-a33b-9d019b977fa7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.694186] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9d153fe4-605f-47fe-a33b-9d019b977fa7',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.089750] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b99e414b-ff9c-4d19-b3c8-32ab58288d75 in Status: SUCCESS [ 925.089750] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b99e414b-ff9c-4d19-b3c8-32ab58288d75" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.090048] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b99e414b-ff9c-4d19-b3c8-32ab58288d75" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.090106] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b99e414b-ff9c-4d19-b3c8-32ab58288d75" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.090292] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.094019] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.094019] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.094019] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.094019] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.094019] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b99e414b-ff9c-4d19-b3c8-32ab58288d75',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.200171] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-9d153fe4-605f-47fe-a33b-9d019b977fa7 taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.200171] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9d153fe4-605f-47fe-a33b-9d019b977fa7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.200171] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9d153fe4-605f-47fe-a33b-9d019b977fa7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.200171] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9d153fe4-605f-47fe-a33b-9d019b977fa7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.200171] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.200171] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.200171] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.200171] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.200171] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.200171] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9d153fe4-605f-47fe-a33b-9d019b977fa7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.200171] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-9d153fe4-605f-47fe-a33b-9d019b977fa7 taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.200171] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9d153fe4-605f-47fe-a33b-9d019b977fa7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.200171] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9d153fe4-605f-47fe-a33b-9d019b977fa7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.200171] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9d153fe4-605f-47fe-a33b-9d019b977fa7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.200171] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.200171] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.200696] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.200696] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.200696] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.200696] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9d153fe4-605f-47fe-a33b-9d019b977fa7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.200696] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9d153fe4-605f-47fe-a33b-9d019b977fa7',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.590212] env[69188]: INFO networking_nsxv3.common.synchronization [req-8a55fd12-c4a3-4caf-acbb-652efb96effb req-031da36b-61b7-41c0-8792-d1162dddcf92 tempest-ServersAdminTestJSON-1988649207 tempest-ServersAdminTestJSON-1988649207-project-member] Enqueued Resource ID: 5e76d42e-7ec6-4a5e-aa9c-c5a285d62318 with Priority: HIGHEST for action security_group_members [ 925.590212] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e76d42e-7ec6-4a5e-aa9c-c5a285d62318 with Priority: HIGHEST for action security_group_members [ 925.590212] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e76d42e-7ec6-4a5e-aa9c-c5a285d62318 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.590212] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e76d42e-7ec6-4a5e-aa9c-c5a285d62318" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.590537] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e76d42e-7ec6-4a5e-aa9c-c5a285d62318" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.590879] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e76d42e-7ec6-4a5e-aa9c-c5a285d62318" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.591184] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.591476] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.591671] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.591907] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.592108] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.592281] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5e76d42e-7ec6-4a5e-aa9c-c5a285d62318',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.593495] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b99e414b-ff9c-4d19-b3c8-32ab58288d75',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.705550] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9d153fe4-605f-47fe-a33b-9d019b977fa7: rpc.has_security_group_logging(os_id): False [ 925.723910] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.723910] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.723910] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.724253] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.724253] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.726147] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.726147] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.726147] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.726147] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.726147] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.726147] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.726147] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.726147] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.726147] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.726147] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.726147] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.726147] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.726147] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.726147] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.726944] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.727118] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9d153fe4-605f-47fe-a33b-9d019b977fa7 is going to be updated. [ 925.786376] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.786571] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.786618] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.787118] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.787118] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.801032] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9d153fe4-605f-47fe-a33b-9d019b977fa7 in Status: IN_PROGRESS for 2s [ 926.095218] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5e76d42e-7ec6-4a5e-aa9c-c5a285d62318',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.097936] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b99e414b-ff9c-4d19-b3c8-32ab58288d75',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.598914] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5e76d42e-7ec6-4a5e-aa9c-c5a285d62318',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.600069] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.600201] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.600264] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.600462] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.600553] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.600648] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b99e414b-ff9c-4d19-b3c8-32ab58288d75 is going to be updated. [ 926.630109] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.630263] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.630331] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.630542] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.630689] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.638965] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b99e414b-ff9c-4d19-b3c8-32ab58288d75 in Status: IN_PROGRESS for 2s [ 927.106886] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.107241] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.107241] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.107352] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.107960] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.107960] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5e76d42e-7ec6-4a5e-aa9c-c5a285d62318 is going to be updated. [ 927.137523] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.138253] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.138358] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.138897] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.139104] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.153858] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5e76d42e-7ec6-4a5e-aa9c-c5a285d62318 in Status: IN_PROGRESS for 2s [ 927.329198] env[69188]: INFO networking_nsxv3.common.synchronization [req-3021de46-9c8f-4564-a8ac-9e04b6993eb7 req-b31e76a5-c588-44d7-abd6-6146def3a958 tempest-ServerActionsTestJSON-1027345226 tempest-ServerActionsTestJSON-1027345226-project-member] Enqueued Resource ID: 725df672-6688-4714-8676-49fbb42ed7bd with Priority: HIGHEST for action security_group_members [ 927.331545] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 725df672-6688-4714-8676-49fbb42ed7bd with Priority: HIGHEST for action security_group_members [ 927.331659] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-725df672-6688-4714-8676-49fbb42ed7bd taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.331739] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-725df672-6688-4714-8676-49fbb42ed7bd" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.331775] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-725df672-6688-4714-8676-49fbb42ed7bd" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.332265] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-725df672-6688-4714-8676-49fbb42ed7bd" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.332470] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.332582] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.332648] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.332820] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.333234] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.333234] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('725df672-6688-4714-8676-49fbb42ed7bd',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 927.757428] env[69188]: INFO networking_nsxv3.common.synchronization [None req-592e06ca-1d01-409b-b0e1-607bfeadc8ea None None] Enqueued Resource ID: 813bb08b-ebd1-48fe-a759-1e280be14496 with Priority: HIGHEST for action port [ 927.758068] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 813bb08b-ebd1-48fe-a759-1e280be14496 with Priority: HIGHEST for action port [ 927.758408] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-813bb08b-ebd1-48fe-a759-1e280be14496 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.758568] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-813bb08b-ebd1-48fe-a759-1e280be14496" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.758652] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-813bb08b-ebd1-48fe-a759-1e280be14496" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.758966] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-813bb08b-ebd1-48fe-a759-1e280be14496" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.759268] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('813bb08b-ebd1-48fe-a759-1e280be14496',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 927.785110] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock network-859 taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.785517] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "network-859" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.785517] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "network-859" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.790475] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "network-859" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.790475] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.790475] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.790475] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.790475] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.790475] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.790805] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 927.790805] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] NeedRegenerationException {{(pid=69188) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 927.791223] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] no value, waiting for create lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 927.792042] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] value creation lock acquired {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 927.792042] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 927.792042] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Calling creation function for not-yet-present value {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 927.792367] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 927.813865] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 927.814868] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69188) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 927.814868] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Released creation lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 927.814971] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "network-859" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.815327] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock port-04380207-2710-4f49-878c-c373e7898a39 taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.815514] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "port-04380207-2710-4f49-878c-c373e7898a39" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.815638] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "port-04380207-2710-4f49-878c-c373e7898a39" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.816021] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "port-04380207-2710-4f49-878c-c373e7898a39" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.817404] env[69188]: DEBUG networking_nsxv3.api.rpc [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('04380207-2710-4f49-878c-c373e7898a39',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 927.818442] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9d153fe4-605f-47fe-a33b-9d019b977fa7 in Status: SUCCESS [ 927.819395] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9d153fe4-605f-47fe-a33b-9d019b977fa7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.835913] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.836114] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.836200] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.836450] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.836650] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.836909] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.837540] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.837540] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.837540] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.837540] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.837540] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 725df672-6688-4714-8676-49fbb42ed7bd already deleted. [ 927.837737] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-725df672-6688-4714-8676-49fbb42ed7bd" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.262556] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 813bb08b-ebd1-48fe-a759-1e280be14496 [ 928.264405] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.264405] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.264405] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.264405] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.264405] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.264405] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:813bb08b-ebd1-48fe-a759-1e280be14496 already deleted. [ 928.264405] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-813bb08b-ebd1-48fe-a759-1e280be14496" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.320234] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.320521] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.323041] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.323041] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.323041] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.323041] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Segment Port 04380207-2710-4f49-878c-c373e7898a39 not found, creating... [ 928.323041] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.323041] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.323041] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.323041] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.324173] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.324529] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.324723] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.324852] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.325163] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.325331] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.325500] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Resource: SegmentPort with ID: 04380207-2710-4f49-878c-c373e7898a39 is going to be created. [ 928.346323] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.346710] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.346941] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.347409] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.347796] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.348353] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "port-04380207-2710-4f49-878c-c373e7898a39" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.652011] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b99e414b-ff9c-4d19-b3c8-32ab58288d75 in Status: IN_PROGRESS for 4s [ 929.164031] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5e76d42e-7ec6-4a5e-aa9c-c5a285d62318 in Status: SUCCESS [ 929.164320] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e76d42e-7ec6-4a5e-aa9c-c5a285d62318" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.198037] env[69188]: INFO networking_nsxv3.common.synchronization [req-3021de46-9c8f-4564-a8ac-9e04b6993eb7 req-2b9bcae2-cae6-4e1a-9b20-4c8d7050ef1f service nova] Enqueued Resource ID: 725df672-6688-4714-8676-49fbb42ed7bd with Priority: HIGHEST for action security_group_rules [ 929.198185] env[69188]: INFO networking_nsxv3.common.synchronization [req-3021de46-9c8f-4564-a8ac-9e04b6993eb7 req-2b9bcae2-cae6-4e1a-9b20-4c8d7050ef1f service nova] Enqueued Resource ID: 725df672-6688-4714-8676-49fbb42ed7bd with Priority: HIGHEST for action security_group_members [ 929.199279] env[69188]: INFO networking_nsxv3.common.synchronization [req-3021de46-9c8f-4564-a8ac-9e04b6993eb7 req-2b9bcae2-cae6-4e1a-9b20-4c8d7050ef1f service nova] Enqueued Resource ID: 04380207-2710-4f49-878c-c373e7898a39 with Priority: HIGHEST for action port [ 929.201690] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 725df672-6688-4714-8676-49fbb42ed7bd with Priority: HIGHEST for action security_group_rules [ 929.201860] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 725df672-6688-4714-8676-49fbb42ed7bd with Priority: HIGHEST for action security_group_members [ 929.201960] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 04380207-2710-4f49-878c-c373e7898a39 with Priority: HIGHEST for action port [ 929.202629] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-725df672-6688-4714-8676-49fbb42ed7bd taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.202783] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-725df672-6688-4714-8676-49fbb42ed7bd" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.202880] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-725df672-6688-4714-8676-49fbb42ed7bd" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.203062] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-725df672-6688-4714-8676-49fbb42ed7bd" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.203150] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('725df672-6688-4714-8676-49fbb42ed7bd',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.204105] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-725df672-6688-4714-8676-49fbb42ed7bd taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.204230] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-725df672-6688-4714-8676-49fbb42ed7bd" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.204298] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-725df672-6688-4714-8676-49fbb42ed7bd" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.204474] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-725df672-6688-4714-8676-49fbb42ed7bd" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.204675] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.204724] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.204759] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.205037] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.205037] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.206697] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('725df672-6688-4714-8676-49fbb42ed7bd',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.207712] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-04380207-2710-4f49-878c-c373e7898a39 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.207870] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-04380207-2710-4f49-878c-c373e7898a39" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.207945] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-04380207-2710-4f49-878c-c373e7898a39" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.208218] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-04380207-2710-4f49-878c-c373e7898a39" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.208218] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('04380207-2710-4f49-878c-c373e7898a39',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.710046] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-725df672-6688-4714-8676-49fbb42ed7bd taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.710438] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-725df672-6688-4714-8676-49fbb42ed7bd" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.710438] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('725df672-6688-4714-8676-49fbb42ed7bd',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.716297] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 04380207-2710-4f49-878c-c373e7898a39 with status ACTIVE [ 929.716401] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.718102] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.718102] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.718102] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.718102] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.718102] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.718102] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.718102] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.718102] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.718102] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.718102] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.718595] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.718595] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.718595] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.718595] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.718800] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 04380207-2710-4f49-878c-c373e7898a39 is going to be updated. [ 929.747542] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.747750] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.747836] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.748158] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.748387] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.748673] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-04380207-2710-4f49-878c-c373e7898a39" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.773082] env[69188]: INFO networking_nsxv3.common.synchronization [None req-eb5eb7aa-ec58-479c-8e67-68378d0e825f None None] Enqueued Resource ID: c45bf6c3-3391-4007-bb0d-aa173864ccb7 with Priority: HIGHEST for action port [ 929.773701] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c45bf6c3-3391-4007-bb0d-aa173864ccb7 with Priority: HIGHEST for action port [ 929.774040] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-c45bf6c3-3391-4007-bb0d-aa173864ccb7 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.774168] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c45bf6c3-3391-4007-bb0d-aa173864ccb7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.774242] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c45bf6c3-3391-4007-bb0d-aa173864ccb7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.774850] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c45bf6c3-3391-4007-bb0d-aa173864ccb7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.774850] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c45bf6c3-3391-4007-bb0d-aa173864ccb7',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.213113] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('725df672-6688-4714-8676-49fbb42ed7bd',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.278633] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c45bf6c3-3391-4007-bb0d-aa173864ccb7 [ 930.278848] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.279013] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.279101] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.279325] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.279417] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.279509] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c45bf6c3-3391-4007-bb0d-aa173864ccb7 already deleted. [ 930.279599] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c45bf6c3-3391-4007-bb0d-aa173864ccb7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.662964] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b99e414b-ff9c-4d19-b3c8-32ab58288d75 in Status: SUCCESS [ 930.663036] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b99e414b-ff9c-4d19-b3c8-32ab58288d75" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.663259] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b99e414b-ff9c-4d19-b3c8-32ab58288d75" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.663523] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b99e414b-ff9c-4d19-b3c8-32ab58288d75" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.663719] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.664450] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.664450] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.664450] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.664450] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.664450] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b99e414b-ff9c-4d19-b3c8-32ab58288d75" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.664450] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b99e414b-ff9c-4d19-b3c8-32ab58288d75',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.715906] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.716492] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.716492] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.716492] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.716985] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.716985] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 725df672-6688-4714-8676-49fbb42ed7bd is going to be created. [ 930.744924] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.745145] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.745193] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.746040] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.747243] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.760344] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 725df672-6688-4714-8676-49fbb42ed7bd in Status: UNINITIALIZED for 2s [ 931.066896] env[69188]: INFO networking_nsxv3.common.synchronization [req-6a8a703a-2608-458b-b93d-ab30db335542 req-7702da6a-1b8b-40eb-9593-3b5f366e603f tempest-VolumesAdminNegativeTest-627287247 tempest-VolumesAdminNegativeTest-627287247-project-member] Enqueued Resource ID: a1ea10ba-bdd7-49b6-97a8-01622e70af27 with Priority: HIGHEST for action security_group_members [ 931.067960] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a1ea10ba-bdd7-49b6-97a8-01622e70af27 with Priority: HIGHEST for action security_group_members [ 931.067960] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-a1ea10ba-bdd7-49b6-97a8-01622e70af27 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.068117] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a1ea10ba-bdd7-49b6-97a8-01622e70af27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.068117] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a1ea10ba-bdd7-49b6-97a8-01622e70af27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.068319] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a1ea10ba-bdd7-49b6-97a8-01622e70af27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.068505] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.068633] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.068711] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.068933] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.069089] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.069239] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a1ea10ba-bdd7-49b6-97a8-01622e70af27',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.169643] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-b99e414b-ff9c-4d19-b3c8-32ab58288d75 taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.169922] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b99e414b-ff9c-4d19-b3c8-32ab58288d75" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.169922] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b99e414b-ff9c-4d19-b3c8-32ab58288d75" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.170107] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b99e414b-ff9c-4d19-b3c8-32ab58288d75" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.170279] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.170386] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.170445] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.170696] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.170696] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.171025] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b99e414b-ff9c-4d19-b3c8-32ab58288d75" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.171025] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-b99e414b-ff9c-4d19-b3c8-32ab58288d75 taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.171025] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b99e414b-ff9c-4d19-b3c8-32ab58288d75" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.171231] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b99e414b-ff9c-4d19-b3c8-32ab58288d75" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.171231] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b99e414b-ff9c-4d19-b3c8-32ab58288d75" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.171332] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.171419] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.171472] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.171601] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.171693] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.171769] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b99e414b-ff9c-4d19-b3c8-32ab58288d75" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.171862] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b99e414b-ff9c-4d19-b3c8-32ab58288d75',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.401017] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock network-836 taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.401017] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "network-836" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.401017] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "network-836" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.401017] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "network-836" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.401017] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.401017] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.404412] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.404412] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.404412] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.404412] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 931.404412] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] NeedRegenerationException {{(pid=69188) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 931.404412] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] no value, waiting for create lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 931.404412] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] value creation lock acquired {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 931.404412] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 931.404412] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Calling creation function for not-yet-present value {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 931.404412] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 931.421250] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 931.424920] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69188) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 931.424920] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Released creation lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 931.424920] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "network-836" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.424920] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock port-987c0305-2b28-4365-b63a-e5ee6d4d2442 taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.424920] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "port-987c0305-2b28-4365-b63a-e5ee6d4d2442" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.424920] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "port-987c0305-2b28-4365-b63a-e5ee6d4d2442" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.424920] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "port-987c0305-2b28-4365-b63a-e5ee6d4d2442" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.424920] env[69188]: DEBUG networking_nsxv3.api.rpc [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('987c0305-2b28-4365-b63a-e5ee6d4d2442',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.526228] env[69188]: INFO networking_nsxv3.common.synchronization [req-cb1b4946-4bec-4e21-98c3-132a630a5a39 req-ba1db866-85b7-4243-9696-d55aa847e00f tempest-DeleteServersTestJSON-857706435 tempest-DeleteServersTestJSON-857706435-project-member] Enqueued Resource ID: 397559b2-3c5a-424d-b09d-43a25d2abba6 with Priority: HIGHEST for action security_group_members [ 931.526228] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 397559b2-3c5a-424d-b09d-43a25d2abba6 with Priority: HIGHEST for action security_group_members [ 931.526228] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-397559b2-3c5a-424d-b09d-43a25d2abba6 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.526228] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-397559b2-3c5a-424d-b09d-43a25d2abba6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.526228] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-397559b2-3c5a-424d-b09d-43a25d2abba6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.526228] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-397559b2-3c5a-424d-b09d-43a25d2abba6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.526228] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.526228] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.526228] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.526228] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.526228] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.526781] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('397559b2-3c5a-424d-b09d-43a25d2abba6',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.575236] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.575236] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.575236] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.575236] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.575236] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.575236] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.575236] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.575236] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.575236] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.575236] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.575236] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a1ea10ba-bdd7-49b6-97a8-01622e70af27 already deleted. [ 931.575236] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a1ea10ba-bdd7-49b6-97a8-01622e70af27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.677096] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b99e414b-ff9c-4d19-b3c8-32ab58288d75: rpc.has_security_group_logging(os_id): False [ 931.698879] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.698879] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.698879] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.698879] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.698879] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.698879] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.698879] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.698879] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.698879] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.698879] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.698879] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.698879] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.698879] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.698879] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.698879] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.699533] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.699533] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.699533] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.699533] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.699533] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.699533] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b99e414b-ff9c-4d19-b3c8-32ab58288d75 is going to be updated. [ 931.781564] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.781564] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.781564] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.782148] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.782148] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.801892] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b99e414b-ff9c-4d19-b3c8-32ab58288d75 in Status: IN_PROGRESS for 2s [ 931.866322] env[69188]: INFO networking_nsxv3.common.synchronization [req-9239b5e6-2cfa-4bc0-8110-89ebed7a6ee8 req-af65432b-db1a-4d07-becc-7f000a5fbd14 tempest-ImagesOneServerNegativeTestJSON-1186419322 tempest-ImagesOneServerNegativeTestJSON-1186419322-project-member] Enqueued Resource ID: 9d153fe4-605f-47fe-a33b-9d019b977fa7 with Priority: HIGHEST for action security_group_members [ 931.866821] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9d153fe4-605f-47fe-a33b-9d019b977fa7 with Priority: HIGHEST for action security_group_members [ 931.867122] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-9d153fe4-605f-47fe-a33b-9d019b977fa7 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.867247] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9d153fe4-605f-47fe-a33b-9d019b977fa7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.867304] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9d153fe4-605f-47fe-a33b-9d019b977fa7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.867500] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9d153fe4-605f-47fe-a33b-9d019b977fa7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.867700] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.867835] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.867896] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.868210] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.868332] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.868450] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9d153fe4-605f-47fe-a33b-9d019b977fa7',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.925584] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.925908] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.926084] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.926428] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.927557] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.927557] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Segment Port 987c0305-2b28-4365-b63a-e5ee6d4d2442 not found, creating... [ 931.927557] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.927557] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.927557] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.927902] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.928108] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.928440] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.928838] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.929041] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.929344] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.929727] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.930787] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Resource: SegmentPort with ID: 987c0305-2b28-4365-b63a-e5ee6d4d2442 is going to be created. [ 931.950073] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.950306] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.950439] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.950702] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.950963] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.951226] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "port-987c0305-2b28-4365-b63a-e5ee6d4d2442" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.028616] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.029887] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.033213] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.033213] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.033213] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.033213] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.033213] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.033213] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.033213] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.033213] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.033213] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 397559b2-3c5a-424d-b09d-43a25d2abba6 is going to be updated. [ 932.066883] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.066883] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.066883] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.066883] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.066883] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.075582] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 397559b2-3c5a-424d-b09d-43a25d2abba6 in Status: IN_PROGRESS for 2s [ 932.118607] env[69188]: INFO networking_nsxv3.common.synchronization [req-ec84b5ff-13b0-473e-b111-33bee0f4e52c req-b69f0c33-e470-4d20-88c0-21a25b65ffbd tempest-SecurityGroupsTestJSON-1621209229 tempest-SecurityGroupsTestJSON-1621209229-project-member] Enqueued Resource ID: b99e414b-ff9c-4d19-b3c8-32ab58288d75 with Priority: HIGHEST for action security_group_members [ 932.118935] env[69188]: INFO networking_nsxv3.common.synchronization [req-ec84b5ff-13b0-473e-b111-33bee0f4e52c req-b69f0c33-e470-4d20-88c0-21a25b65ffbd tempest-SecurityGroupsTestJSON-1621209229 tempest-SecurityGroupsTestJSON-1621209229-project-member] Enqueued Resource ID: 3d37bee8-a6a2-465c-be52-6cc5e558ec26 with Priority: HIGHEST for action security_group_members [ 932.119753] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b99e414b-ff9c-4d19-b3c8-32ab58288d75 with Priority: HIGHEST for action security_group_members [ 932.123068] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3d37bee8-a6a2-465c-be52-6cc5e558ec26 with Priority: HIGHEST for action security_group_members [ 932.123068] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-b99e414b-ff9c-4d19-b3c8-32ab58288d75 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.123068] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b99e414b-ff9c-4d19-b3c8-32ab58288d75" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.123068] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b99e414b-ff9c-4d19-b3c8-32ab58288d75" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.123068] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b99e414b-ff9c-4d19-b3c8-32ab58288d75" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.123068] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.123068] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.123068] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.123068] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.123068] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.123068] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b99e414b-ff9c-4d19-b3c8-32ab58288d75',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.123068] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-3d37bee8-a6a2-465c-be52-6cc5e558ec26 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.123068] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3d37bee8-a6a2-465c-be52-6cc5e558ec26" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.123068] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3d37bee8-a6a2-465c-be52-6cc5e558ec26" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.123068] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3d37bee8-a6a2-465c-be52-6cc5e558ec26" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.124103] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.124427] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.124815] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.125282] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.125469] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.125677] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3d37bee8-a6a2-465c-be52-6cc5e558ec26',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.172115] env[69188]: INFO networking_nsxv3.common.synchronization [req-ec84b5ff-13b0-473e-b111-33bee0f4e52c req-b69f0c33-e470-4d20-88c0-21a25b65ffbd tempest-SecurityGroupsTestJSON-1621209229 tempest-SecurityGroupsTestJSON-1621209229-project-member] Enqueued Resource ID: 3d37bee8-a6a2-465c-be52-6cc5e558ec26 with Priority: HIGHEST for action security_group_rules [ 932.172115] env[69188]: INFO networking_nsxv3.common.synchronization [req-ec84b5ff-13b0-473e-b111-33bee0f4e52c req-b69f0c33-e470-4d20-88c0-21a25b65ffbd tempest-SecurityGroupsTestJSON-1621209229 tempest-SecurityGroupsTestJSON-1621209229-project-member] Enqueued Resource ID: 3d37bee8-a6a2-465c-be52-6cc5e558ec26 with Priority: HIGHEST for action security_group_members [ 932.172115] env[69188]: INFO networking_nsxv3.common.synchronization [req-ec84b5ff-13b0-473e-b111-33bee0f4e52c req-b69f0c33-e470-4d20-88c0-21a25b65ffbd tempest-SecurityGroupsTestJSON-1621209229 tempest-SecurityGroupsTestJSON-1621209229-project-member] Enqueued Resource ID: b99e414b-ff9c-4d19-b3c8-32ab58288d75 with Priority: HIGHEST for action security_group_rules [ 932.172115] env[69188]: INFO networking_nsxv3.common.synchronization [req-ec84b5ff-13b0-473e-b111-33bee0f4e52c req-b69f0c33-e470-4d20-88c0-21a25b65ffbd tempest-SecurityGroupsTestJSON-1621209229 tempest-SecurityGroupsTestJSON-1621209229-project-member] Enqueued Resource ID: b99e414b-ff9c-4d19-b3c8-32ab58288d75 with Priority: HIGHEST for action security_group_members [ 932.172115] env[69188]: INFO networking_nsxv3.common.synchronization [req-ec84b5ff-13b0-473e-b111-33bee0f4e52c req-b69f0c33-e470-4d20-88c0-21a25b65ffbd tempest-SecurityGroupsTestJSON-1621209229 tempest-SecurityGroupsTestJSON-1621209229-project-member] Enqueued Resource ID: bf835081-b81d-435a-95c8-cc555e6e5bf8 with Priority: HIGHEST for action port [ 932.172115] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3d37bee8-a6a2-465c-be52-6cc5e558ec26 with Priority: HIGHEST for action security_group_rules [ 932.172115] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b99e414b-ff9c-4d19-b3c8-32ab58288d75 with Priority: HIGHEST for action security_group_rules [ 932.172115] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bf835081-b81d-435a-95c8-cc555e6e5bf8 with Priority: HIGHEST for action port [ 932.172115] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3d37bee8-a6a2-465c-be52-6cc5e558ec26 with Priority: HIGHEST for action security_group_members [ 932.172115] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b99e414b-ff9c-4d19-b3c8-32ab58288d75 with Priority: HIGHEST for action security_group_members [ 932.172925] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3d37bee8-a6a2-465c-be52-6cc5e558ec26 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.173201] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3d37bee8-a6a2-465c-be52-6cc5e558ec26" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.173656] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3d37bee8-a6a2-465c-be52-6cc5e558ec26" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.174212] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3d37bee8-a6a2-465c-be52-6cc5e558ec26" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.174384] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3d37bee8-a6a2-465c-be52-6cc5e558ec26',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.175960] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b99e414b-ff9c-4d19-b3c8-32ab58288d75 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.176227] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b99e414b-ff9c-4d19-b3c8-32ab58288d75" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.177373] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-bf835081-b81d-435a-95c8-cc555e6e5bf8 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.177373] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bf835081-b81d-435a-95c8-cc555e6e5bf8" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.177373] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bf835081-b81d-435a-95c8-cc555e6e5bf8" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.177373] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bf835081-b81d-435a-95c8-cc555e6e5bf8" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.177373] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bf835081-b81d-435a-95c8-cc555e6e5bf8',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.179522] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-3d37bee8-a6a2-465c-be52-6cc5e558ec26 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.179522] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3d37bee8-a6a2-465c-be52-6cc5e558ec26" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.179522] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-b99e414b-ff9c-4d19-b3c8-32ab58288d75 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.179522] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b99e414b-ff9c-4d19-b3c8-32ab58288d75" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.372125] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.372297] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.372373] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.372587] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.372679] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.372874] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.372964] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.373038] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.373203] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.373259] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.373339] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9d153fe4-605f-47fe-a33b-9d019b977fa7 is going to be updated. [ 932.399205] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.399205] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.399205] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.399205] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.399205] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.411695] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9d153fe4-605f-47fe-a33b-9d019b977fa7 in Status: IN_PROGRESS for 2s [ 932.629192] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b99e414b-ff9c-4d19-b3c8-32ab58288d75',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.630616] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3d37bee8-a6a2-465c-be52-6cc5e558ec26',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.681035] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bf835081-b81d-435a-95c8-cc555e6e5bf8 with status ACTIVE [ 932.681035] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.681035] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.681316] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.681316] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.681382] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.682267] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.682267] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.682267] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.682267] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.682267] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.682267] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.682267] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.682267] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.682605] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.682605] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.682605] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bf835081-b81d-435a-95c8-cc555e6e5bf8 is going to be updated. [ 932.687100] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-3d37bee8-a6a2-465c-be52-6cc5e558ec26 taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.687221] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3d37bee8-a6a2-465c-be52-6cc5e558ec26" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.708552] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.708842] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.708930] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.709293] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.709444] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.709652] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bf835081-b81d-435a-95c8-cc555e6e5bf8" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.769615] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 725df672-6688-4714-8676-49fbb42ed7bd in Status: SUCCESS [ 932.769897] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-725df672-6688-4714-8676-49fbb42ed7bd" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.770077] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-725df672-6688-4714-8676-49fbb42ed7bd" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.770284] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-725df672-6688-4714-8676-49fbb42ed7bd" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.770495] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.770583] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.770646] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.770794] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.770875] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.770959] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-725df672-6688-4714-8676-49fbb42ed7bd" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.771069] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('725df672-6688-4714-8676-49fbb42ed7bd',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.777069] env[69188]: INFO networking_nsxv3.common.synchronization [req-6a8a703a-2608-458b-b93d-ab30db335542 req-c3c0c54f-8646-4654-b9c4-1232e6e70887 service nova] Enqueued Resource ID: a1ea10ba-bdd7-49b6-97a8-01622e70af27 with Priority: HIGHEST for action security_group_rules [ 932.777183] env[69188]: INFO networking_nsxv3.common.synchronization [req-6a8a703a-2608-458b-b93d-ab30db335542 req-c3c0c54f-8646-4654-b9c4-1232e6e70887 service nova] Enqueued Resource ID: a1ea10ba-bdd7-49b6-97a8-01622e70af27 with Priority: HIGHEST for action security_group_members [ 932.777296] env[69188]: INFO networking_nsxv3.common.synchronization [req-6a8a703a-2608-458b-b93d-ab30db335542 req-c3c0c54f-8646-4654-b9c4-1232e6e70887 service nova] Enqueued Resource ID: 987c0305-2b28-4365-b63a-e5ee6d4d2442 with Priority: HIGHEST for action port [ 932.777513] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a1ea10ba-bdd7-49b6-97a8-01622e70af27 with Priority: HIGHEST for action security_group_rules [ 932.777635] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a1ea10ba-bdd7-49b6-97a8-01622e70af27 with Priority: HIGHEST for action security_group_members [ 932.777728] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 987c0305-2b28-4365-b63a-e5ee6d4d2442 with Priority: HIGHEST for action port [ 932.778446] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a1ea10ba-bdd7-49b6-97a8-01622e70af27 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.778446] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a1ea10ba-bdd7-49b6-97a8-01622e70af27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.778446] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a1ea10ba-bdd7-49b6-97a8-01622e70af27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.778824] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a1ea10ba-bdd7-49b6-97a8-01622e70af27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.780141] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a1ea10ba-bdd7-49b6-97a8-01622e70af27',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.780500] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-a1ea10ba-bdd7-49b6-97a8-01622e70af27 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.780500] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a1ea10ba-bdd7-49b6-97a8-01622e70af27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.780500] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a1ea10ba-bdd7-49b6-97a8-01622e70af27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.780623] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a1ea10ba-bdd7-49b6-97a8-01622e70af27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.781980] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.781980] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.781980] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.781980] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.781980] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.781980] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a1ea10ba-bdd7-49b6-97a8-01622e70af27',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.782558] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-987c0305-2b28-4365-b63a-e5ee6d4d2442 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.782558] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-987c0305-2b28-4365-b63a-e5ee6d4d2442" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.782692] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-987c0305-2b28-4365-b63a-e5ee6d4d2442" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.782834] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-987c0305-2b28-4365-b63a-e5ee6d4d2442" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.782834] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('987c0305-2b28-4365-b63a-e5ee6d4d2442',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 933.132425] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b99e414b-ff9c-4d19-b3c8-32ab58288d75',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 933.134041] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3d37bee8-a6a2-465c-be52-6cc5e558ec26',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 933.274954] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('725df672-6688-4714-8676-49fbb42ed7bd',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 933.280617] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-a1ea10ba-bdd7-49b6-97a8-01622e70af27 taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.280742] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a1ea10ba-bdd7-49b6-97a8-01622e70af27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.282748] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a1ea10ba-bdd7-49b6-97a8-01622e70af27',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 933.284375] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 987c0305-2b28-4365-b63a-e5ee6d4d2442 with status ACTIVE [ 933.284980] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.284980] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.284980] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.284980] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.284980] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.285238] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.285238] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.285316] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.285445] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.285511] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.285689] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.285803] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.285852] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.285993] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.286079] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.286153] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 987c0305-2b28-4365-b63a-e5ee6d4d2442 is going to be updated. [ 933.305493] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.305685] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.305773] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.306350] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.306350] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.306553] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-987c0305-2b28-4365-b63a-e5ee6d4d2442" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.639627] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.639627] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.639627] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.639627] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.639627] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.639627] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b99e414b-ff9c-4d19-b3c8-32ab58288d75 is going to be updated. [ 933.639968] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.639968] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.639968] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.640179] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.640283] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.640375] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3d37bee8-a6a2-465c-be52-6cc5e558ec26 is going to be created. [ 933.666708] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.666914] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.667021] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.667336] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.667594] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.670046] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.670330] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.670330] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.670581] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.670831] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.680559] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3d37bee8-a6a2-465c-be52-6cc5e558ec26 in Status: UNINITIALIZED for 2s [ 933.681288] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b99e414b-ff9c-4d19-b3c8-32ab58288d75 in Status: IN_PROGRESS for 2s [ 933.734133] env[69188]: INFO networking_nsxv3.common.synchronization [req-c6fba2d7-d488-4ddf-a17f-61d40f088214 req-f48b148e-ed00-417e-bade-3b5db4fc0122 tempest-ServersTestJSON-1495057482 tempest-ServersTestJSON-1495057482-project-member] Enqueued Resource ID: 9f2518e8-b195-4520-b262-caa765ab7e27 with Priority: HIGHEST for action security_group_members [ 933.734743] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f2518e8-b195-4520-b262-caa765ab7e27 with Priority: HIGHEST for action security_group_members [ 933.735761] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-9f2518e8-b195-4520-b262-caa765ab7e27 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.735761] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9f2518e8-b195-4520-b262-caa765ab7e27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.735761] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9f2518e8-b195-4520-b262-caa765ab7e27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.735957] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9f2518e8-b195-4520-b262-caa765ab7e27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.735957] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.736080] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.736145] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.736316] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.736412] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.736523] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9f2518e8-b195-4520-b262-caa765ab7e27',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 933.778703] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 725df672-6688-4714-8676-49fbb42ed7bd: rpc.has_security_group_logging(os_id): False [ 933.784205] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a1ea10ba-bdd7-49b6-97a8-01622e70af27',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 933.796891] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.799020] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.799020] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.799020] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.799020] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.799020] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.799020] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.799020] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.799020] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.799020] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.799020] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 725df672-6688-4714-8676-49fbb42ed7bd is going to be created. [ 933.820207] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b99e414b-ff9c-4d19-b3c8-32ab58288d75 in Status: SUCCESS [ 933.820948] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b99e414b-ff9c-4d19-b3c8-32ab58288d75" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.821868] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b99e414b-ff9c-4d19-b3c8-32ab58288d75" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.821868] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b99e414b-ff9c-4d19-b3c8-32ab58288d75" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.821868] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b99e414b-ff9c-4d19-b3c8-32ab58288d75',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 933.865025] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.865025] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.865025] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.865025] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.865025] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.877280] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 725df672-6688-4714-8676-49fbb42ed7bd in Status: IN_PROGRESS for 2s [ 934.085282] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 397559b2-3c5a-424d-b09d-43a25d2abba6 in Status: SUCCESS [ 934.085484] env[69188]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 397559b2-3c5a-424d-b09d-43a25d2abba6 deletion is rescheduled due to dependency. [ 934.085571] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-397559b2-3c5a-424d-b09d-43a25d2abba6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.228253] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock network-507 taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.228253] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "network-507" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.228253] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "network-507" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.228253] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "network-507" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.228253] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.228253] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.228253] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.228253] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.228253] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.229181] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 934.229380] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] NeedRegenerationException {{(pid=69188) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 934.229465] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] no value, waiting for create lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 934.229586] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] value creation lock acquired {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 934.229713] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 934.229853] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Calling creation function for not-yet-present value {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 934.229964] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 934.238334] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9f2518e8-b195-4520-b262-caa765ab7e27',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 934.247216] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 934.247389] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=69188) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 934.247579] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Released creation lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 934.249020] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "network-507" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.249020] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock port-99f8f1ea-85f0-4104-aadd-f2058e59fe7e taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.249020] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "port-99f8f1ea-85f0-4104-aadd-f2058e59fe7e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.249020] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "port-99f8f1ea-85f0-4104-aadd-f2058e59fe7e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.249020] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "port-99f8f1ea-85f0-4104-aadd-f2058e59fe7e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.249020] env[69188]: DEBUG networking_nsxv3.api.rpc [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('99f8f1ea-85f0-4104-aadd-f2058e59fe7e',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 934.287641] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.287782] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.287854] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.288199] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.288199] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.288310] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a1ea10ba-bdd7-49b6-97a8-01622e70af27 is going to be created. [ 934.311819] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.311819] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.311819] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.312240] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.312448] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.323361] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a1ea10ba-bdd7-49b6-97a8-01622e70af27 in Status: UNINITIALIZED for 2s [ 934.327533] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-b99e414b-ff9c-4d19-b3c8-32ab58288d75 taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.327533] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b99e414b-ff9c-4d19-b3c8-32ab58288d75" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.422025] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9d153fe4-605f-47fe-a33b-9d019b977fa7 in Status: SUCCESS [ 934.422025] env[69188]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9d153fe4-605f-47fe-a33b-9d019b977fa7 deletion is rescheduled due to dependency. [ 934.422025] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9d153fe4-605f-47fe-a33b-9d019b977fa7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.721666] env[69188]: INFO networking_nsxv3.common.synchronization [req-c3712409-3a80-471a-b3e8-d3e8f54a2907 req-b8e51f6c-0891-4cff-ab11-8ffab9e3616c tempest-MigrationsAdminTest-718349773 tempest-MigrationsAdminTest-718349773-project-member] Enqueued Resource ID: 345a1564-5c47-4d81-9096-66a6ad96570a with Priority: HIGHEST for action security_group_members [ 934.721666] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 345a1564-5c47-4d81-9096-66a6ad96570a with Priority: HIGHEST for action security_group_members [ 934.721666] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-345a1564-5c47-4d81-9096-66a6ad96570a taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.721666] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-345a1564-5c47-4d81-9096-66a6ad96570a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.721666] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-345a1564-5c47-4d81-9096-66a6ad96570a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.721666] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-345a1564-5c47-4d81-9096-66a6ad96570a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.721666] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.721666] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.721666] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.722211] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.722211] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.722211] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('345a1564-5c47-4d81-9096-66a6ad96570a',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 934.742479] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9f2518e8-b195-4520-b262-caa765ab7e27',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 934.756343] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.756343] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.756343] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.756343] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.756343] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.756697] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Segment Port 99f8f1ea-85f0-4104-aadd-f2058e59fe7e not found, creating... [ 934.757335] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.757335] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.757554] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.757887] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.758481] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.758574] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.758762] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.758943] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.759220] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.759383] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.759535] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Resource: SegmentPort with ID: 99f8f1ea-85f0-4104-aadd-f2058e59fe7e is going to be created. [ 934.794909] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.795376] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.795436] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.795841] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.796221] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.796535] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "port-99f8f1ea-85f0-4104-aadd-f2058e59fe7e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.226604] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('345a1564-5c47-4d81-9096-66a6ad96570a',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 935.244586] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.244782] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.244864] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.245168] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.245268] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.245366] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9f2518e8-b195-4520-b262-caa765ab7e27 is going to be updated. [ 935.273513] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.273725] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.273802] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.274041] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.274205] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.282854] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9f2518e8-b195-4520-b262-caa765ab7e27 in Status: IN_PROGRESS for 2s [ 935.574154] env[69188]: INFO networking_nsxv3.common.synchronization [req-c6fba2d7-d488-4ddf-a17f-61d40f088214 req-e03d8264-9836-44b2-a2b4-87f84561f543 service nova] Enqueued Resource ID: 9f2518e8-b195-4520-b262-caa765ab7e27 with Priority: HIGHEST for action security_group_rules [ 935.574154] env[69188]: INFO networking_nsxv3.common.synchronization [req-c6fba2d7-d488-4ddf-a17f-61d40f088214 req-e03d8264-9836-44b2-a2b4-87f84561f543 service nova] Enqueued Resource ID: 9f2518e8-b195-4520-b262-caa765ab7e27 with Priority: HIGHEST for action security_group_members [ 935.574154] env[69188]: INFO networking_nsxv3.common.synchronization [req-c6fba2d7-d488-4ddf-a17f-61d40f088214 req-e03d8264-9836-44b2-a2b4-87f84561f543 service nova] Enqueued Resource ID: 99f8f1ea-85f0-4104-aadd-f2058e59fe7e with Priority: HIGHEST for action port [ 935.574154] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f2518e8-b195-4520-b262-caa765ab7e27 with Priority: HIGHEST for action security_group_rules [ 935.574154] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f2518e8-b195-4520-b262-caa765ab7e27 with Priority: HIGHEST for action security_group_members [ 935.574154] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 99f8f1ea-85f0-4104-aadd-f2058e59fe7e with Priority: HIGHEST for action port [ 935.576339] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9f2518e8-b195-4520-b262-caa765ab7e27 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.576339] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9f2518e8-b195-4520-b262-caa765ab7e27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.576339] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9f2518e8-b195-4520-b262-caa765ab7e27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.576339] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9f2518e8-b195-4520-b262-caa765ab7e27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.576339] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9f2518e8-b195-4520-b262-caa765ab7e27',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 935.577083] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-9f2518e8-b195-4520-b262-caa765ab7e27 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.577434] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9f2518e8-b195-4520-b262-caa765ab7e27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.577761] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-99f8f1ea-85f0-4104-aadd-f2058e59fe7e taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.578056] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-99f8f1ea-85f0-4104-aadd-f2058e59fe7e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.578250] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-99f8f1ea-85f0-4104-aadd-f2058e59fe7e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.578874] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-99f8f1ea-85f0-4104-aadd-f2058e59fe7e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.579152] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('99f8f1ea-85f0-4104-aadd-f2058e59fe7e',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 935.694511] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b99e414b-ff9c-4d19-b3c8-32ab58288d75 in Status: SUCCESS [ 935.694511] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b99e414b-ff9c-4d19-b3c8-32ab58288d75" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.694511] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b99e414b-ff9c-4d19-b3c8-32ab58288d75" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.694511] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b99e414b-ff9c-4d19-b3c8-32ab58288d75" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.694511] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.694511] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.694511] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.694511] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.694511] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.694511] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b99e414b-ff9c-4d19-b3c8-32ab58288d75',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 935.696427] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3d37bee8-a6a2-465c-be52-6cc5e558ec26 in Status: SUCCESS [ 935.697018] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3d37bee8-a6a2-465c-be52-6cc5e558ec26" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.697418] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3d37bee8-a6a2-465c-be52-6cc5e558ec26" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.697743] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3d37bee8-a6a2-465c-be52-6cc5e558ec26" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.698033] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.698262] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.698441] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.698733] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.698922] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.699272] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3d37bee8-a6a2-465c-be52-6cc5e558ec26',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 935.732011] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('345a1564-5c47-4d81-9096-66a6ad96570a',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 935.891397] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 725df672-6688-4714-8676-49fbb42ed7bd in Status: SUCCESS [ 935.891657] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-725df672-6688-4714-8676-49fbb42ed7bd" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.975117] env[69188]: INFO networking_nsxv3.common.synchronization [req-84343108-f2c1-4e25-b14d-34fd74ac1552 req-7ed0c327-4260-4147-a780-47d6721b451f tempest-AttachInterfacesUnderV243Test-1529073749 tempest-AttachInterfacesUnderV243Test-1529073749-project-member] Enqueued Resource ID: e4039e1d-9712-484a-9e32-16f2dc6c2311 with Priority: HIGHEST for action security_group_members [ 935.976113] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e4039e1d-9712-484a-9e32-16f2dc6c2311 with Priority: HIGHEST for action security_group_members [ 935.977172] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-e4039e1d-9712-484a-9e32-16f2dc6c2311 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.977335] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e4039e1d-9712-484a-9e32-16f2dc6c2311" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.977408] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e4039e1d-9712-484a-9e32-16f2dc6c2311" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.977642] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e4039e1d-9712-484a-9e32-16f2dc6c2311" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.977812] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.977930] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.977997] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.978421] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.978538] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.978656] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e4039e1d-9712-484a-9e32-16f2dc6c2311',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 936.011744] env[69188]: INFO networking_nsxv3.common.synchronization [req-84343108-f2c1-4e25-b14d-34fd74ac1552 req-7ed0c327-4260-4147-a780-47d6721b451f tempest-AttachInterfacesUnderV243Test-1529073749 tempest-AttachInterfacesUnderV243Test-1529073749-project-member] Enqueued Resource ID: e4039e1d-9712-484a-9e32-16f2dc6c2311 with Priority: HIGHEST for action security_group_rules [ 936.012073] env[69188]: INFO networking_nsxv3.common.synchronization [req-84343108-f2c1-4e25-b14d-34fd74ac1552 req-7ed0c327-4260-4147-a780-47d6721b451f tempest-AttachInterfacesUnderV243Test-1529073749 tempest-AttachInterfacesUnderV243Test-1529073749-project-member] Enqueued Resource ID: e4039e1d-9712-484a-9e32-16f2dc6c2311 with Priority: HIGHEST for action security_group_members [ 936.012343] env[69188]: INFO networking_nsxv3.common.synchronization [req-84343108-f2c1-4e25-b14d-34fd74ac1552 req-7ed0c327-4260-4147-a780-47d6721b451f tempest-AttachInterfacesUnderV243Test-1529073749 tempest-AttachInterfacesUnderV243Test-1529073749-project-member] Enqueued Resource ID: 6e07ff78-73eb-473b-8e22-21cfea849f70 with Priority: HIGHEST for action port [ 936.013416] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e4039e1d-9712-484a-9e32-16f2dc6c2311 with Priority: HIGHEST for action security_group_rules [ 936.013526] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e4039e1d-9712-484a-9e32-16f2dc6c2311 with Priority: HIGHEST for action security_group_members [ 936.013721] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e07ff78-73eb-473b-8e22-21cfea849f70 with Priority: HIGHEST for action port [ 936.014220] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e4039e1d-9712-484a-9e32-16f2dc6c2311 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.017764] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e4039e1d-9712-484a-9e32-16f2dc6c2311" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.017764] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e4039e1d-9712-484a-9e32-16f2dc6c2311" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.017764] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e4039e1d-9712-484a-9e32-16f2dc6c2311" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.017764] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e4039e1d-9712-484a-9e32-16f2dc6c2311',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 936.017764] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-e4039e1d-9712-484a-9e32-16f2dc6c2311 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.017764] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e4039e1d-9712-484a-9e32-16f2dc6c2311" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.017764] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-6e07ff78-73eb-473b-8e22-21cfea849f70 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.017764] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6e07ff78-73eb-473b-8e22-21cfea849f70" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.017764] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6e07ff78-73eb-473b-8e22-21cfea849f70" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.017764] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6e07ff78-73eb-473b-8e22-21cfea849f70" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.017764] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6e07ff78-73eb-473b-8e22-21cfea849f70',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 936.081399] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 99f8f1ea-85f0-4104-aadd-f2058e59fe7e with status ACTIVE [ 936.082157] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.082157] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.082157] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.082367] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.082367] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.083122] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.083122] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.083122] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.083122] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.083122] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.083122] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.083390] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.083390] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.083467] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.083507] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.083785] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 99f8f1ea-85f0-4104-aadd-f2058e59fe7e is going to be updated. [ 936.084789] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-9f2518e8-b195-4520-b262-caa765ab7e27 taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.084911] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9f2518e8-b195-4520-b262-caa765ab7e27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.104938] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.105108] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.105198] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.105417] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.105586] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.105757] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-99f8f1ea-85f0-4104-aadd-f2058e59fe7e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.196592] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b99e414b-ff9c-4d19-b3c8-32ab58288d75',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 936.201409] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3d37bee8-a6a2-465c-be52-6cc5e558ec26',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 936.234302] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.235127] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.235262] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.235488] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.235577] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.235681] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 345a1564-5c47-4d81-9096-66a6ad96570a is going to be updated. [ 936.268393] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.268563] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.268720] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.269010] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.269247] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.279818] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 345a1564-5c47-4d81-9096-66a6ad96570a in Status: IN_PROGRESS for 2s [ 936.340038] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a1ea10ba-bdd7-49b6-97a8-01622e70af27 in Status: SUCCESS [ 936.340199] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a1ea10ba-bdd7-49b6-97a8-01622e70af27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.340664] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a1ea10ba-bdd7-49b6-97a8-01622e70af27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.340921] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a1ea10ba-bdd7-49b6-97a8-01622e70af27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.341128] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.341246] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.341313] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.341470] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.341549] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.341697] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a1ea10ba-bdd7-49b6-97a8-01622e70af27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.341808] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a1ea10ba-bdd7-49b6-97a8-01622e70af27',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 936.482381] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e4039e1d-9712-484a-9e32-16f2dc6c2311',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 936.524195] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-e4039e1d-9712-484a-9e32-16f2dc6c2311 taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.524195] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e4039e1d-9712-484a-9e32-16f2dc6c2311" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.524195] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6e07ff78-73eb-473b-8e22-21cfea849f70 with status ACTIVE [ 936.524195] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.524195] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.524195] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.524195] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.524195] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.524195] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.524195] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.524195] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.524195] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.524195] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.524675] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.524675] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.524675] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.524675] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.524675] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.524675] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6e07ff78-73eb-473b-8e22-21cfea849f70 is going to be updated. [ 936.550814] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.550814] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.550814] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.551037] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.551165] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.551327] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6e07ff78-73eb-473b-8e22-21cfea849f70" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.698692] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b99e414b-ff9c-4d19-b3c8-32ab58288d75',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 936.703525] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3d37bee8-a6a2-465c-be52-6cc5e558ec26',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 936.845523] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-a1ea10ba-bdd7-49b6-97a8-01622e70af27 taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.845818] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a1ea10ba-bdd7-49b6-97a8-01622e70af27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.845818] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a1ea10ba-bdd7-49b6-97a8-01622e70af27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.846224] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a1ea10ba-bdd7-49b6-97a8-01622e70af27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.846224] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.846224] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.846377] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.846449] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.846547] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.846645] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a1ea10ba-bdd7-49b6-97a8-01622e70af27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.846816] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-a1ea10ba-bdd7-49b6-97a8-01622e70af27 taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.846916] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a1ea10ba-bdd7-49b6-97a8-01622e70af27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.846973] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a1ea10ba-bdd7-49b6-97a8-01622e70af27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.847141] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a1ea10ba-bdd7-49b6-97a8-01622e70af27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.847270] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.847368] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.847417] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.847591] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.847650] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.847754] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a1ea10ba-bdd7-49b6-97a8-01622e70af27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.847846] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a1ea10ba-bdd7-49b6-97a8-01622e70af27',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 936.985439] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e4039e1d-9712-484a-9e32-16f2dc6c2311',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 937.204803] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.204972] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.205054] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.205284] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.205381] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.205486] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b99e414b-ff9c-4d19-b3c8-32ab58288d75 is going to be updated. [ 937.208856] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.209101] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.209185] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.209390] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.209480] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.209576] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3d37bee8-a6a2-465c-be52-6cc5e558ec26 is going to be updated. [ 937.236042] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.236042] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.236042] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.236042] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.236042] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.237446] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.237630] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.237723] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.237977] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.238179] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.247251] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3d37bee8-a6a2-465c-be52-6cc5e558ec26 in Status: IN_PROGRESS for 2s [ 937.248204] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b99e414b-ff9c-4d19-b3c8-32ab58288d75 in Status: IN_PROGRESS for 2s [ 937.296116] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9f2518e8-b195-4520-b262-caa765ab7e27 in Status: SUCCESS [ 937.296116] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9f2518e8-b195-4520-b262-caa765ab7e27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.296116] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9f2518e8-b195-4520-b262-caa765ab7e27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.296116] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9f2518e8-b195-4520-b262-caa765ab7e27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.296116] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.296116] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.296116] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.296116] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.296116] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.296116] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9f2518e8-b195-4520-b262-caa765ab7e27',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 937.352153] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a1ea10ba-bdd7-49b6-97a8-01622e70af27: rpc.has_security_group_logging(os_id): False [ 937.369168] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.369168] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.369168] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.369168] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.369333] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.369426] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.369626] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.369626] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.369854] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.369854] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.369990] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.370097] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.370159] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.370293] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.370366] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.370556] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.370674] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.370707] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.370830] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.370904] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.371013] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a1ea10ba-bdd7-49b6-97a8-01622e70af27 is going to be created. [ 937.425064] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.425208] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.425280] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.425491] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.425675] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.436274] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a1ea10ba-bdd7-49b6-97a8-01622e70af27 in Status: IN_PROGRESS for 2s [ 937.493222] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.493222] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.493222] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.493222] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.493222] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.493222] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e4039e1d-9712-484a-9e32-16f2dc6c2311 is going to be updated. [ 937.562886] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.562886] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.562886] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.562886] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.562886] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.580136] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e4039e1d-9712-484a-9e32-16f2dc6c2311 in Status: IN_PROGRESS for 2s [ 937.797116] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9f2518e8-b195-4520-b262-caa765ab7e27',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 937.880115] env[69188]: INFO networking_nsxv3.common.synchronization [req-3259f80e-5ddd-4e90-a53a-f555d08af6c5 req-6d5ff60d-a12d-40ea-8faf-3b8ced9a6a76 tempest-SecurityGroupsTestJSON-1621209229 tempest-SecurityGroupsTestJSON-1621209229-project-member] Enqueued Resource ID: b99e414b-ff9c-4d19-b3c8-32ab58288d75 with Priority: HIGHEST for action security_group_members [ 937.880115] env[69188]: INFO networking_nsxv3.common.synchronization [req-3259f80e-5ddd-4e90-a53a-f555d08af6c5 req-6d5ff60d-a12d-40ea-8faf-3b8ced9a6a76 tempest-SecurityGroupsTestJSON-1621209229 tempest-SecurityGroupsTestJSON-1621209229-project-member] Enqueued Resource ID: 3d37bee8-a6a2-465c-be52-6cc5e558ec26 with Priority: HIGHEST for action security_group_members [ 937.880115] env[69188]: INFO networking_nsxv3.common.synchronization [req-3259f80e-5ddd-4e90-a53a-f555d08af6c5 req-6d5ff60d-a12d-40ea-8faf-3b8ced9a6a76 tempest-SecurityGroupsTestJSON-1621209229 tempest-SecurityGroupsTestJSON-1621209229-project-member] Enqueued Resource ID: 68c0c7c8-beeb-4934-8aa4-53092d0eb5f1 with Priority: HIGHEST for action security_group_members [ 937.880115] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b99e414b-ff9c-4d19-b3c8-32ab58288d75 with Priority: HIGHEST for action security_group_members [ 937.880115] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3d37bee8-a6a2-465c-be52-6cc5e558ec26 with Priority: HIGHEST for action security_group_members [ 937.880115] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 68c0c7c8-beeb-4934-8aa4-53092d0eb5f1 with Priority: HIGHEST for action security_group_members [ 937.880115] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-b99e414b-ff9c-4d19-b3c8-32ab58288d75 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.880115] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b99e414b-ff9c-4d19-b3c8-32ab58288d75" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.880115] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-3d37bee8-a6a2-465c-be52-6cc5e558ec26 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.880115] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3d37bee8-a6a2-465c-be52-6cc5e558ec26" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.881597] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-68c0c7c8-beeb-4934-8aa4-53092d0eb5f1 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.881597] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-68c0c7c8-beeb-4934-8aa4-53092d0eb5f1" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.881597] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-68c0c7c8-beeb-4934-8aa4-53092d0eb5f1" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.881597] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-68c0c7c8-beeb-4934-8aa4-53092d0eb5f1" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.881597] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.881597] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.881597] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.881597] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.881597] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.881597] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('68c0c7c8-beeb-4934-8aa4-53092d0eb5f1',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 938.027302] env[69188]: INFO networking_nsxv3.common.synchronization [req-3259f80e-5ddd-4e90-a53a-f555d08af6c5 req-6d5ff60d-a12d-40ea-8faf-3b8ced9a6a76 tempest-SecurityGroupsTestJSON-1621209229 tempest-SecurityGroupsTestJSON-1621209229-project-member] Enqueued Resource ID: 3d37bee8-a6a2-465c-be52-6cc5e558ec26 with Priority: HIGHEST for action security_group_rules [ 938.027589] env[69188]: INFO networking_nsxv3.common.synchronization [req-3259f80e-5ddd-4e90-a53a-f555d08af6c5 req-6d5ff60d-a12d-40ea-8faf-3b8ced9a6a76 tempest-SecurityGroupsTestJSON-1621209229 tempest-SecurityGroupsTestJSON-1621209229-project-member] Enqueued Resource ID: 3d37bee8-a6a2-465c-be52-6cc5e558ec26 with Priority: HIGHEST for action security_group_members [ 938.027687] env[69188]: INFO networking_nsxv3.common.synchronization [req-3259f80e-5ddd-4e90-a53a-f555d08af6c5 req-6d5ff60d-a12d-40ea-8faf-3b8ced9a6a76 tempest-SecurityGroupsTestJSON-1621209229 tempest-SecurityGroupsTestJSON-1621209229-project-member] Enqueued Resource ID: 68c0c7c8-beeb-4934-8aa4-53092d0eb5f1 with Priority: HIGHEST for action security_group_rules [ 938.027824] env[69188]: INFO networking_nsxv3.common.synchronization [req-3259f80e-5ddd-4e90-a53a-f555d08af6c5 req-6d5ff60d-a12d-40ea-8faf-3b8ced9a6a76 tempest-SecurityGroupsTestJSON-1621209229 tempest-SecurityGroupsTestJSON-1621209229-project-member] Enqueued Resource ID: 68c0c7c8-beeb-4934-8aa4-53092d0eb5f1 with Priority: HIGHEST for action security_group_members [ 938.027954] env[69188]: INFO networking_nsxv3.common.synchronization [req-3259f80e-5ddd-4e90-a53a-f555d08af6c5 req-6d5ff60d-a12d-40ea-8faf-3b8ced9a6a76 tempest-SecurityGroupsTestJSON-1621209229 tempest-SecurityGroupsTestJSON-1621209229-project-member] Enqueued Resource ID: b99e414b-ff9c-4d19-b3c8-32ab58288d75 with Priority: HIGHEST for action security_group_rules [ 938.028097] env[69188]: INFO networking_nsxv3.common.synchronization [req-3259f80e-5ddd-4e90-a53a-f555d08af6c5 req-6d5ff60d-a12d-40ea-8faf-3b8ced9a6a76 tempest-SecurityGroupsTestJSON-1621209229 tempest-SecurityGroupsTestJSON-1621209229-project-member] Enqueued Resource ID: b99e414b-ff9c-4d19-b3c8-32ab58288d75 with Priority: HIGHEST for action security_group_members [ 938.028242] env[69188]: INFO networking_nsxv3.common.synchronization [req-3259f80e-5ddd-4e90-a53a-f555d08af6c5 req-6d5ff60d-a12d-40ea-8faf-3b8ced9a6a76 tempest-SecurityGroupsTestJSON-1621209229 tempest-SecurityGroupsTestJSON-1621209229-project-member] Enqueued Resource ID: bf835081-b81d-435a-95c8-cc555e6e5bf8 with Priority: HIGHEST for action port [ 938.028757] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3d37bee8-a6a2-465c-be52-6cc5e558ec26 with Priority: HIGHEST for action security_group_rules [ 938.029015] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 68c0c7c8-beeb-4934-8aa4-53092d0eb5f1 with Priority: HIGHEST for action security_group_rules [ 938.029015] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b99e414b-ff9c-4d19-b3c8-32ab58288d75 with Priority: HIGHEST for action security_group_members [ 938.029119] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bf835081-b81d-435a-95c8-cc555e6e5bf8 with Priority: HIGHEST for action port [ 938.029311] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b99e414b-ff9c-4d19-b3c8-32ab58288d75 with Priority: HIGHEST for action security_group_rules [ 938.029311] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3d37bee8-a6a2-465c-be52-6cc5e558ec26 with Priority: HIGHEST for action security_group_members [ 938.029492] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 68c0c7c8-beeb-4934-8aa4-53092d0eb5f1 with Priority: HIGHEST for action security_group_members [ 938.029889] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3d37bee8-a6a2-465c-be52-6cc5e558ec26 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.029950] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3d37bee8-a6a2-465c-be52-6cc5e558ec26" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.030209] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-68c0c7c8-beeb-4934-8aa4-53092d0eb5f1 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.030367] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-68c0c7c8-beeb-4934-8aa4-53092d0eb5f1" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.030411] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-68c0c7c8-beeb-4934-8aa4-53092d0eb5f1" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.030637] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-68c0c7c8-beeb-4934-8aa4-53092d0eb5f1" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.030720] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('68c0c7c8-beeb-4934-8aa4-53092d0eb5f1',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 938.031589] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-b99e414b-ff9c-4d19-b3c8-32ab58288d75 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.031681] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b99e414b-ff9c-4d19-b3c8-32ab58288d75" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.031870] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-bf835081-b81d-435a-95c8-cc555e6e5bf8 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.031972] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bf835081-b81d-435a-95c8-cc555e6e5bf8" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.032044] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bf835081-b81d-435a-95c8-cc555e6e5bf8" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.032354] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bf835081-b81d-435a-95c8-cc555e6e5bf8" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.032493] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bf835081-b81d-435a-95c8-cc555e6e5bf8',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 938.033623] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b99e414b-ff9c-4d19-b3c8-32ab58288d75 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.033721] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b99e414b-ff9c-4d19-b3c8-32ab58288d75" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.033905] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-3d37bee8-a6a2-465c-be52-6cc5e558ec26 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.033985] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3d37bee8-a6a2-465c-be52-6cc5e558ec26" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.034171] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-68c0c7c8-beeb-4934-8aa4-53092d0eb5f1 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.034251] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-68c0c7c8-beeb-4934-8aa4-53092d0eb5f1" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.289409] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 345a1564-5c47-4d81-9096-66a6ad96570a in Status: SUCCESS [ 938.289698] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-345a1564-5c47-4d81-9096-66a6ad96570a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.301756] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9f2518e8-b195-4520-b262-caa765ab7e27',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 938.384286] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('68c0c7c8-beeb-4934-8aa4-53092d0eb5f1',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 938.535701] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-68c0c7c8-beeb-4934-8aa4-53092d0eb5f1 taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.535839] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-68c0c7c8-beeb-4934-8aa4-53092d0eb5f1" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.536033] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bf835081-b81d-435a-95c8-cc555e6e5bf8 with status ACTIVE [ 938.536206] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.536314] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.536387] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.536609] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.536768] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.536892] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.536990] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.537074] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.537247] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.537523] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.537523] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.537622] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.537653] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.537788] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.537848] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.537936] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bf835081-b81d-435a-95c8-cc555e6e5bf8 is going to be updated. [ 938.558811] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.558961] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.559051] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.559270] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.559416] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.559580] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bf835081-b81d-435a-95c8-cc555e6e5bf8" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.804669] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.804669] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.804669] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.804942] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.804974] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.805123] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9f2518e8-b195-4520-b262-caa765ab7e27 is going to be updated. [ 938.870911] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.871180] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.871253] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.871482] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.871625] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.880656] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9f2518e8-b195-4520-b262-caa765ab7e27 in Status: IN_PROGRESS for 2s [ 938.885109] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('68c0c7c8-beeb-4934-8aa4-53092d0eb5f1',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 939.097746] env[69188]: INFO networking_nsxv3.common.synchronization [req-01b245cb-8a1a-4d24-9342-181dd7a8dc71 req-3284c0f1-cc5e-430a-9eae-0b1a09530b39 tempest-ImagesTestJSON-2034330654 tempest-ImagesTestJSON-2034330654-project-member] Enqueued Resource ID: 199db626-eef5-4a20-b92a-585841c1cff4 with Priority: HIGHEST for action security_group_members [ 939.098330] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 199db626-eef5-4a20-b92a-585841c1cff4 with Priority: HIGHEST for action security_group_members [ 939.098706] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-199db626-eef5-4a20-b92a-585841c1cff4 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.098866] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-199db626-eef5-4a20-b92a-585841c1cff4" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.098981] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-199db626-eef5-4a20-b92a-585841c1cff4" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.099268] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-199db626-eef5-4a20-b92a-585841c1cff4" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.099383] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.099434] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.099471] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.099589] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.099670] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.099765] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('199db626-eef5-4a20-b92a-585841c1cff4',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 939.263123] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3d37bee8-a6a2-465c-be52-6cc5e558ec26 in Status: SUCCESS [ 939.263383] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3d37bee8-a6a2-465c-be52-6cc5e558ec26" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.264208] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b99e414b-ff9c-4d19-b3c8-32ab58288d75 in Status: SUCCESS [ 939.264385] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b99e414b-ff9c-4d19-b3c8-32ab58288d75" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.264558] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3d37bee8-a6a2-465c-be52-6cc5e558ec26" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.264855] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3d37bee8-a6a2-465c-be52-6cc5e558ec26" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.264983] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.265134] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.265185] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.265454] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.265454] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.265627] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3d37bee8-a6a2-465c-be52-6cc5e558ec26" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.265687] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3d37bee8-a6a2-465c-be52-6cc5e558ec26',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 939.266715] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b99e414b-ff9c-4d19-b3c8-32ab58288d75" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.266966] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b99e414b-ff9c-4d19-b3c8-32ab58288d75" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.267092] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.267244] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.267292] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.267513] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.267584] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.267731] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b99e414b-ff9c-4d19-b3c8-32ab58288d75" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.267975] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b99e414b-ff9c-4d19-b3c8-32ab58288d75',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 939.268971] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3d37bee8-a6a2-465c-be52-6cc5e558ec26" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.269105] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3d37bee8-a6a2-465c-be52-6cc5e558ec26" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.269316] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.269467] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.269562] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.269785] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.270028] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.270028] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3d37bee8-a6a2-465c-be52-6cc5e558ec26',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 939.274773] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b99e414b-ff9c-4d19-b3c8-32ab58288d75" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.274773] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b99e414b-ff9c-4d19-b3c8-32ab58288d75" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.274773] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.274773] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.274773] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.274773] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.274773] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.274773] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b99e414b-ff9c-4d19-b3c8-32ab58288d75',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 939.388795] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.388795] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.388795] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.388795] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.388795] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.388795] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 68c0c7c8-beeb-4934-8aa4-53092d0eb5f1 is going to be created. [ 939.411324] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.413771] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.413910] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.414195] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.414380] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.422829] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 68c0c7c8-beeb-4934-8aa4-53092d0eb5f1 in Status: UNINITIALIZED for 2s [ 939.446995] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a1ea10ba-bdd7-49b6-97a8-01622e70af27 in Status: SUCCESS [ 939.451022] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a1ea10ba-bdd7-49b6-97a8-01622e70af27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.471961] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock network-410 taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.472178] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "network-410" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.472346] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "network-410" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.472693] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "network-410" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.473052] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.473280] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.473443] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.473755] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.473986] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.474249] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 939.474364] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] NeedRegenerationException {{(pid=69188) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 939.474474] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] no value, waiting for create lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 939.474605] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] value creation lock acquired {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 939.474723] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 939.474839] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Calling creation function for not-yet-present value {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 939.474969] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 939.496761] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 939.497042] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69188) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 939.497332] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Released creation lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 939.497508] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "network-410" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.497915] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock port-638536e4-2202-43c9-967f-ef191d2a8faa taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.498227] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "port-638536e4-2202-43c9-967f-ef191d2a8faa" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.498373] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "port-638536e4-2202-43c9-967f-ef191d2a8faa" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.498802] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "port-638536e4-2202-43c9-967f-ef191d2a8faa" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.499010] env[69188]: DEBUG networking_nsxv3.api.rpc [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('638536e4-2202-43c9-967f-ef191d2a8faa',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 939.592026] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e4039e1d-9712-484a-9e32-16f2dc6c2311 in Status: SUCCESS [ 939.592026] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e4039e1d-9712-484a-9e32-16f2dc6c2311" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.592026] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e4039e1d-9712-484a-9e32-16f2dc6c2311" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.592026] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e4039e1d-9712-484a-9e32-16f2dc6c2311" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.592026] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.592026] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.592026] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.592026] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.592026] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.592026] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e4039e1d-9712-484a-9e32-16f2dc6c2311',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 939.606062] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.606062] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.606062] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.606062] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.606062] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.606062] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.606062] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.606062] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.606062] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.606062] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.606062] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 199db626-eef5-4a20-b92a-585841c1cff4 is going to be updated. [ 939.636874] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.636874] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.636874] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.636874] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.636874] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.643851] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 199db626-eef5-4a20-b92a-585841c1cff4 in Status: IN_PROGRESS for 2s [ 939.769439] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3d37bee8-a6a2-465c-be52-6cc5e558ec26',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 939.776048] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-b99e414b-ff9c-4d19-b3c8-32ab58288d75 taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.776177] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b99e414b-ff9c-4d19-b3c8-32ab58288d75" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.776363] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3d37bee8-a6a2-465c-be52-6cc5e558ec26',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 939.777666] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b99e414b-ff9c-4d19-b3c8-32ab58288d75',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 939.905025] env[69188]: INFO networking_nsxv3.common.synchronization [req-7a0b0da4-9abc-4d34-970d-0293f9223ecf req-608b2c4b-694f-41fb-bfc5-2b7f7e3abd9b tempest-AttachInterfacesUnderV243Test-1529073749 tempest-AttachInterfacesUnderV243Test-1529073749-project-member] Enqueued Resource ID: e4039e1d-9712-484a-9e32-16f2dc6c2311 with Priority: HIGHEST for action security_group_members [ 939.905848] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e4039e1d-9712-484a-9e32-16f2dc6c2311 with Priority: HIGHEST for action security_group_members [ 939.905848] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-e4039e1d-9712-484a-9e32-16f2dc6c2311 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.905848] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e4039e1d-9712-484a-9e32-16f2dc6c2311" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.919203] env[69188]: INFO networking_nsxv3.common.synchronization [req-7a0b0da4-9abc-4d34-970d-0293f9223ecf req-608b2c4b-694f-41fb-bfc5-2b7f7e3abd9b tempest-AttachInterfacesUnderV243Test-1529073749 tempest-AttachInterfacesUnderV243Test-1529073749-project-member] Enqueued Resource ID: e4039e1d-9712-484a-9e32-16f2dc6c2311 with Priority: HIGHEST for action security_group_rules [ 939.919203] env[69188]: INFO networking_nsxv3.common.synchronization [req-7a0b0da4-9abc-4d34-970d-0293f9223ecf req-608b2c4b-694f-41fb-bfc5-2b7f7e3abd9b tempest-AttachInterfacesUnderV243Test-1529073749 tempest-AttachInterfacesUnderV243Test-1529073749-project-member] Enqueued Resource ID: e4039e1d-9712-484a-9e32-16f2dc6c2311 with Priority: HIGHEST for action security_group_members [ 939.919203] env[69188]: INFO networking_nsxv3.common.synchronization [req-7a0b0da4-9abc-4d34-970d-0293f9223ecf req-608b2c4b-694f-41fb-bfc5-2b7f7e3abd9b tempest-AttachInterfacesUnderV243Test-1529073749 tempest-AttachInterfacesUnderV243Test-1529073749-project-member] Enqueued Resource ID: 6e07ff78-73eb-473b-8e22-21cfea849f70 with Priority: HIGHEST for action port [ 939.919203] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e4039e1d-9712-484a-9e32-16f2dc6c2311 with Priority: HIGHEST for action security_group_rules [ 939.919203] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e4039e1d-9712-484a-9e32-16f2dc6c2311 with Priority: HIGHEST for action security_group_members [ 939.919203] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e07ff78-73eb-473b-8e22-21cfea849f70 with Priority: HIGHEST for action port [ 939.919724] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e4039e1d-9712-484a-9e32-16f2dc6c2311 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.919933] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e4039e1d-9712-484a-9e32-16f2dc6c2311" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.920221] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-e4039e1d-9712-484a-9e32-16f2dc6c2311 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.920423] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e4039e1d-9712-484a-9e32-16f2dc6c2311" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.920876] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-6e07ff78-73eb-473b-8e22-21cfea849f70 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.921079] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6e07ff78-73eb-473b-8e22-21cfea849f70" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.921224] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6e07ff78-73eb-473b-8e22-21cfea849f70" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.921551] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6e07ff78-73eb-473b-8e22-21cfea849f70" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.921720] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6e07ff78-73eb-473b-8e22-21cfea849f70',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 940.001713] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.002094] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.002353] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.002668] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.002830] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.002997] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Segment Port 638536e4-2202-43c9-967f-ef191d2a8faa not found, creating... [ 940.003352] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.003467] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.003571] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.004363] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.004363] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.004363] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.004551] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.004551] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.006017] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.006017] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.006017] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Resource: SegmentPort with ID: 638536e4-2202-43c9-967f-ef191d2a8faa is going to be created. [ 940.030554] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.030855] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.031054] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.031361] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.031955] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.031955] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "port-638536e4-2202-43c9-967f-ef191d2a8faa" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.094371] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e4039e1d-9712-484a-9e32-16f2dc6c2311',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 940.272053] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3d37bee8-a6a2-465c-be52-6cc5e558ec26: rpc.has_security_group_logging(os_id): False [ 940.278977] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3d37bee8-a6a2-465c-be52-6cc5e558ec26',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 940.280016] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b99e414b-ff9c-4d19-b3c8-32ab58288d75',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 940.292745] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.292745] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.292895] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.292971] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.293074] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.293285] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.293399] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.293445] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.293574] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.293656] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.293740] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3d37bee8-a6a2-465c-be52-6cc5e558ec26 is going to be created. [ 940.414310] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.415135] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.415272] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.415501] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.415739] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.424263] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6e07ff78-73eb-473b-8e22-21cfea849f70 with status ACTIVE [ 940.424544] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.424691] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.424761] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.425042] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.425323] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.425556] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.425697] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.425791] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.426008] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.426132] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.426372] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.426508] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.426596] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.427361] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.427361] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.427361] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6e07ff78-73eb-473b-8e22-21cfea849f70 is going to be updated. [ 940.429279] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3d37bee8-a6a2-465c-be52-6cc5e558ec26 in Status: IN_PROGRESS for 2s [ 940.448399] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.448594] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.448697] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.448883] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.449058] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.449245] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6e07ff78-73eb-473b-8e22-21cfea849f70" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.596363] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e4039e1d-9712-484a-9e32-16f2dc6c2311',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 940.781908] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.782271] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.782369] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.782636] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.782746] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.782859] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3d37bee8-a6a2-465c-be52-6cc5e558ec26 is going to be updated. [ 940.784240] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.784379] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.784435] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.784619] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.784698] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.784787] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b99e414b-ff9c-4d19-b3c8-32ab58288d75 is going to be updated. [ 940.818480] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.818617] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.818763] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.818989] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.819117] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.821339] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.821511] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.821591] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.822160] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.822160] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.833266] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b99e414b-ff9c-4d19-b3c8-32ab58288d75 in Status: IN_PROGRESS for 2s [ 940.833266] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3d37bee8-a6a2-465c-be52-6cc5e558ec26 in Status: IN_PROGRESS for 2s [ 940.890776] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9f2518e8-b195-4520-b262-caa765ab7e27 in Status: SUCCESS [ 940.891534] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9f2518e8-b195-4520-b262-caa765ab7e27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.891534] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9f2518e8-b195-4520-b262-caa765ab7e27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.891773] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9f2518e8-b195-4520-b262-caa765ab7e27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.892062] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.892269] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.892355] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.892570] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.892676] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.892771] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9f2518e8-b195-4520-b262-caa765ab7e27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.893154] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9f2518e8-b195-4520-b262-caa765ab7e27',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 940.922424] env[69188]: INFO networking_nsxv3.common.synchronization [req-01b245cb-8a1a-4d24-9342-181dd7a8dc71 req-57c53d91-1f36-45d7-83dd-c655876378a4 service nova] Enqueued Resource ID: 199db626-eef5-4a20-b92a-585841c1cff4 with Priority: HIGHEST for action security_group_rules [ 940.922424] env[69188]: INFO networking_nsxv3.common.synchronization [req-01b245cb-8a1a-4d24-9342-181dd7a8dc71 req-57c53d91-1f36-45d7-83dd-c655876378a4 service nova] Enqueued Resource ID: 199db626-eef5-4a20-b92a-585841c1cff4 with Priority: HIGHEST for action security_group_members [ 940.922424] env[69188]: INFO networking_nsxv3.common.synchronization [req-01b245cb-8a1a-4d24-9342-181dd7a8dc71 req-57c53d91-1f36-45d7-83dd-c655876378a4 service nova] Enqueued Resource ID: 638536e4-2202-43c9-967f-ef191d2a8faa with Priority: HIGHEST for action port [ 940.922424] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 199db626-eef5-4a20-b92a-585841c1cff4 with Priority: HIGHEST for action security_group_rules [ 940.922424] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 199db626-eef5-4a20-b92a-585841c1cff4 with Priority: HIGHEST for action security_group_members [ 940.922424] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 638536e4-2202-43c9-967f-ef191d2a8faa with Priority: HIGHEST for action port [ 940.922424] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-199db626-eef5-4a20-b92a-585841c1cff4 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.922424] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-199db626-eef5-4a20-b92a-585841c1cff4" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.922424] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-199db626-eef5-4a20-b92a-585841c1cff4" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.922843] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-199db626-eef5-4a20-b92a-585841c1cff4" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.922843] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('199db626-eef5-4a20-b92a-585841c1cff4',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 940.923616] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-199db626-eef5-4a20-b92a-585841c1cff4 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.924029] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-199db626-eef5-4a20-b92a-585841c1cff4" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.924029] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-638536e4-2202-43c9-967f-ef191d2a8faa taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.924206] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-638536e4-2202-43c9-967f-ef191d2a8faa" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.924206] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-638536e4-2202-43c9-967f-ef191d2a8faa" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.924369] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-638536e4-2202-43c9-967f-ef191d2a8faa" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.924566] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('638536e4-2202-43c9-967f-ef191d2a8faa',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 940.964608] env[69188]: INFO networking_nsxv3.common.synchronization [req-affc3253-779e-41a5-9d56-a5d0205f80c2 req-e6a7c75c-6333-4ee0-be23-9350779947c9 tempest-SecurityGroupsTestJSON-1621209229 tempest-SecurityGroupsTestJSON-1621209229-project-member] Enqueued Resource ID: b99e414b-ff9c-4d19-b3c8-32ab58288d75 with Priority: HIGHEST for action security_group_members [ 940.969024] env[69188]: INFO networking_nsxv3.common.synchronization [req-affc3253-779e-41a5-9d56-a5d0205f80c2 req-e6a7c75c-6333-4ee0-be23-9350779947c9 tempest-SecurityGroupsTestJSON-1621209229 tempest-SecurityGroupsTestJSON-1621209229-project-member] Enqueued Resource ID: 68c0c7c8-beeb-4934-8aa4-53092d0eb5f1 with Priority: HIGHEST for action security_group_members [ 940.969024] env[69188]: INFO networking_nsxv3.common.synchronization [req-affc3253-779e-41a5-9d56-a5d0205f80c2 req-e6a7c75c-6333-4ee0-be23-9350779947c9 tempest-SecurityGroupsTestJSON-1621209229 tempest-SecurityGroupsTestJSON-1621209229-project-member] Enqueued Resource ID: 3d37bee8-a6a2-465c-be52-6cc5e558ec26 with Priority: HIGHEST for action security_group_members [ 940.969024] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b99e414b-ff9c-4d19-b3c8-32ab58288d75 with Priority: HIGHEST for action security_group_members [ 940.969024] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 68c0c7c8-beeb-4934-8aa4-53092d0eb5f1 with Priority: HIGHEST for action security_group_members [ 940.969024] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3d37bee8-a6a2-465c-be52-6cc5e558ec26 with Priority: HIGHEST for action security_group_members [ 940.969024] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-b99e414b-ff9c-4d19-b3c8-32ab58288d75 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.969306] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b99e414b-ff9c-4d19-b3c8-32ab58288d75" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.969531] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-68c0c7c8-beeb-4934-8aa4-53092d0eb5f1 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.969638] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-68c0c7c8-beeb-4934-8aa4-53092d0eb5f1" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.969891] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-3d37bee8-a6a2-465c-be52-6cc5e558ec26 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.969936] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3d37bee8-a6a2-465c-be52-6cc5e558ec26" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.101725] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.101725] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.101725] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.101725] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.101725] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.101725] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e4039e1d-9712-484a-9e32-16f2dc6c2311 is going to be updated. [ 941.129465] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.129465] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.129465] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.129465] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.129465] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.139740] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e4039e1d-9712-484a-9e32-16f2dc6c2311 in Status: IN_PROGRESS for 2s [ 941.395839] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-9f2518e8-b195-4520-b262-caa765ab7e27 taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.395839] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9f2518e8-b195-4520-b262-caa765ab7e27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.396188] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9f2518e8-b195-4520-b262-caa765ab7e27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.396188] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9f2518e8-b195-4520-b262-caa765ab7e27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.396344] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.396449] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.396517] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.396721] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.396849] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.396961] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9f2518e8-b195-4520-b262-caa765ab7e27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.397151] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-9f2518e8-b195-4520-b262-caa765ab7e27 taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.397253] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9f2518e8-b195-4520-b262-caa765ab7e27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.397327] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9f2518e8-b195-4520-b262-caa765ab7e27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.397710] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9f2518e8-b195-4520-b262-caa765ab7e27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.397973] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.398220] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.398297] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.398462] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.398551] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.398647] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9f2518e8-b195-4520-b262-caa765ab7e27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.398887] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9f2518e8-b195-4520-b262-caa765ab7e27',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.427343] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-199db626-eef5-4a20-b92a-585841c1cff4 taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.427343] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-199db626-eef5-4a20-b92a-585841c1cff4" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.427519] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 638536e4-2202-43c9-967f-ef191d2a8faa with status ACTIVE [ 941.427655] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.427763] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.427849] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.428042] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.428169] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.428299] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.428394] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.428454] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.428605] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.428740] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.428938] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.429114] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.429287] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.429504] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.429556] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.429715] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 638536e4-2202-43c9-967f-ef191d2a8faa is going to be updated. [ 941.432521] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 68c0c7c8-beeb-4934-8aa4-53092d0eb5f1 in Status: SUCCESS [ 941.432707] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-68c0c7c8-beeb-4934-8aa4-53092d0eb5f1" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.433160] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-68c0c7c8-beeb-4934-8aa4-53092d0eb5f1" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.433332] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-68c0c7c8-beeb-4934-8aa4-53092d0eb5f1" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.433487] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.433630] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.433676] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.433790] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.433868] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.433957] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('68c0c7c8-beeb-4934-8aa4-53092d0eb5f1',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.453068] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.453231] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.453301] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.453501] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.453646] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.453810] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-638536e4-2202-43c9-967f-ef191d2a8faa" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.659498] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 199db626-eef5-4a20-b92a-585841c1cff4 in Status: IN_PROGRESS for 4s [ 941.905699] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9f2518e8-b195-4520-b262-caa765ab7e27: rpc.has_security_group_logging(os_id): False [ 941.924099] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.924280] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.924354] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.924585] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.924692] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.924900] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.925054] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.925139] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.925404] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.925488] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.925668] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.925774] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.925774] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.925902] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.925983] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.926209] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.926306] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.926364] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.926503] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.926573] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.926686] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9f2518e8-b195-4520-b262-caa765ab7e27 is going to be updated. [ 941.936288] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.936431] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.936497] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.936636] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.936722] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.936880] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.936987] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.937074] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.937185] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.937256] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.937343] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 68c0c7c8-beeb-4934-8aa4-53092d0eb5f1 is going to be deleted. [ 941.964315] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.964524] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.964636] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.965100] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.965168] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.965296] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-68c0c7c8-beeb-4934-8aa4-53092d0eb5f1" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.965526] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-68c0c7c8-beeb-4934-8aa4-53092d0eb5f1" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.965775] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-68c0c7c8-beeb-4934-8aa4-53092d0eb5f1" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.966053] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.966240] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.966355] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.966606] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.966754] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.966912] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('68c0c7c8-beeb-4934-8aa4-53092d0eb5f1',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.993787] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.994010] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.994107] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.994349] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.994501] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.006647] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9f2518e8-b195-4520-b262-caa765ab7e27 in Status: IN_PROGRESS for 2s [ 942.441968] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3d37bee8-a6a2-465c-be52-6cc5e558ec26 in Status: SUCCESS [ 942.442358] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3d37bee8-a6a2-465c-be52-6cc5e558ec26" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.442358] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3d37bee8-a6a2-465c-be52-6cc5e558ec26" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.443424] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3d37bee8-a6a2-465c-be52-6cc5e558ec26" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.443424] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3d37bee8-a6a2-465c-be52-6cc5e558ec26',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.469626] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.469789] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.469857] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.470106] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.470204] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.470404] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.470564] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.470564] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.470720] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.470799] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.470886] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 68c0c7c8-beeb-4934-8aa4-53092d0eb5f1 already deleted. [ 942.471023] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-68c0c7c8-beeb-4934-8aa4-53092d0eb5f1" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.471134] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('68c0c7c8-beeb-4934-8aa4-53092d0eb5f1',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.475434] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-68c0c7c8-beeb-4934-8aa4-53092d0eb5f1" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.475434] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-68c0c7c8-beeb-4934-8aa4-53092d0eb5f1" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.475434] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.475434] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.475434] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.475434] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.475434] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.475434] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('68c0c7c8-beeb-4934-8aa4-53092d0eb5f1',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.848029] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b99e414b-ff9c-4d19-b3c8-32ab58288d75 in Status: SUCCESS [ 942.848304] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b99e414b-ff9c-4d19-b3c8-32ab58288d75" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.848528] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b99e414b-ff9c-4d19-b3c8-32ab58288d75" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.848833] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b99e414b-ff9c-4d19-b3c8-32ab58288d75" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.849046] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.849171] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.849237] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.849389] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.849467] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.849560] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b99e414b-ff9c-4d19-b3c8-32ab58288d75',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.854401] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3d37bee8-a6a2-465c-be52-6cc5e558ec26 in Status: SUCCESS [ 942.854862] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3d37bee8-a6a2-465c-be52-6cc5e558ec26" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.854862] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3d37bee8-a6a2-465c-be52-6cc5e558ec26" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.855066] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3d37bee8-a6a2-465c-be52-6cc5e558ec26" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.855146] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.855297] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.855357] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.855511] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.855586] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.855680] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3d37bee8-a6a2-465c-be52-6cc5e558ec26',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.965516] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.965516] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.965516] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.965516] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.965856] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.965856] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3d37bee8-a6a2-465c-be52-6cc5e558ec26 is going to be deleted. [ 942.976516] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('68c0c7c8-beeb-4934-8aa4-53092d0eb5f1',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.977729] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.977897] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.977965] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.978219] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.978351] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.978577] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.978758] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.978798] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.978962] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.979086] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.979177] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 68c0c7c8-beeb-4934-8aa4-53092d0eb5f1 already deleted. [ 942.979282] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-68c0c7c8-beeb-4934-8aa4-53092d0eb5f1" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.019438] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.019682] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.019682] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.019909] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.020016] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.020138] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3d37bee8-a6a2-465c-be52-6cc5e558ec26" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.149736] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e4039e1d-9712-484a-9e32-16f2dc6c2311 in Status: SUCCESS [ 943.149964] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e4039e1d-9712-484a-9e32-16f2dc6c2311" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.150156] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e4039e1d-9712-484a-9e32-16f2dc6c2311" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.150418] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e4039e1d-9712-484a-9e32-16f2dc6c2311" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.150614] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.150819] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.150819] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.150971] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.151076] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.151167] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e4039e1d-9712-484a-9e32-16f2dc6c2311" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.151265] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e4039e1d-9712-484a-9e32-16f2dc6c2311',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 943.152106] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e4039e1d-9712-484a-9e32-16f2dc6c2311" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.152270] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e4039e1d-9712-484a-9e32-16f2dc6c2311" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.152429] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.152532] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.152591] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.153807] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.153807] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.153807] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e4039e1d-9712-484a-9e32-16f2dc6c2311',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 943.357879] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b99e414b-ff9c-4d19-b3c8-32ab58288d75',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 943.359964] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.359964] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.360166] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.360764] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.360885] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.361104] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.361209] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.361408] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.361566] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.361566] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.361632] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3d37bee8-a6a2-465c-be52-6cc5e558ec26 is going to be deleted. [ 943.387314] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.387663] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.387762] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.387959] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.388072] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.388271] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3d37bee8-a6a2-465c-be52-6cc5e558ec26" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.388632] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3d37bee8-a6a2-465c-be52-6cc5e558ec26" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.388838] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3d37bee8-a6a2-465c-be52-6cc5e558ec26" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.389032] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.389117] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.389175] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.389315] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.389416] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.389507] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3d37bee8-a6a2-465c-be52-6cc5e558ec26',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 943.480479] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 68c0c7c8-beeb-4934-8aa4-53092d0eb5f1: rpc.has_security_group_logging(os_id): False [ 943.501911] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.501911] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.501911] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.501911] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.501911] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.501911] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.501911] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.501911] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.501911] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.501911] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.501911] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 68c0c7c8-beeb-4934-8aa4-53092d0eb5f1 is going to be created. [ 943.517141] env[69188]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/68c0c7c8-beeb-4934-8aa4-53092d0eb5f1], does not exist path=[/infra/domains/default/groups/68c0c7c8-beeb-4934-8aa4-53092d0eb5f1]."\n}' [ 943.517426] env[69188]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 68c0c7c8-beeb-4934-8aa4-53092d0eb5f1 failed to be updated, retrying after metadata refresh: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/68c0c7c8-beeb-4934-8aa4-53092d0eb5f1 [ 943.517584] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 943.547182] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.547380] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.547481] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.547747] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.549173] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.549734] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.549867] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.549942] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.550158] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.550317] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.550576] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.550870] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.550983] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.551276] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.551382] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.551496] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 68c0c7c8-beeb-4934-8aa4-53092d0eb5f1 is going to be created. [ 943.566250] env[69188]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/68c0c7c8-beeb-4934-8aa4-53092d0eb5f1], does not exist path=[/infra/domains/default/groups/68c0c7c8-beeb-4934-8aa4-53092d0eb5f1]."\n}': requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/68c0c7c8-beeb-4934-8aa4-53092d0eb5f1 [ 943.566411] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-68c0c7c8-beeb-4934-8aa4-53092d0eb5f1" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.566636] env[69188]: Traceback (most recent call last): [ 943.566714] env[69188]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 36, in wrapper [ 943.566714] env[69188]: return func(*args, **kwargs) [ 943.566714] env[69188]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 943.566714] env[69188]: res.raise_for_status() [ 943.566714] env[69188]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1024, in raise_for_status [ 943.566714] env[69188]: raise HTTPError(http_error_msg, response=self) [ 943.566714] env[69188]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/68c0c7c8-beeb-4934-8aa4-53092d0eb5f1 [ 943.566714] env[69188]: During handling of the above exception, another exception occurred: [ 943.566714] env[69188]: Traceback (most recent call last): [ 943.566714] env[69188]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/hubs/poll.py", line 111, in wait [ 943.566714] env[69188]: listener.cb(fileno) [ 943.566714] env[69188]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py", line 272, in main [ 943.566714] env[69188]: result = function(*args, **kwargs) [ 943.566714] env[69188]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py", line 210, in security_group_rules [ 943.566714] env[69188]: self.nsx_provider.sg_rules_realize(os_sg, logged=logged) [ 943.566714] env[69188]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 1012, in sg_rules_realize [ 943.566714] env[69188]: return self._realize(Provider.SG_RULES, delete, self.payload.sg_rules_container, os_sg, provider_sg) [ 943.567188] env[69188]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 45, in wrapper [ 943.567188] env[69188]: return func(self, resource_type, delete, self.payload.sg_rules_container, os_obj, provider_sg) [ 943.567188] env[69188]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 943.567188] env[69188]: res.raise_for_status() [ 943.567188] env[69188]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1024, in raise_for_status [ 943.567188] env[69188]: raise HTTPError(http_error_msg, response=self) [ 943.567188] env[69188]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/68c0c7c8-beeb-4934-8aa4-53092d0eb5f1 [ 943.567188] env[69188]: Removing descriptor: 18 [ 943.655260] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e4039e1d-9712-484a-9e32-16f2dc6c2311',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 943.658237] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e4039e1d-9712-484a-9e32-16f2dc6c2311',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 943.669376] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 199db626-eef5-4a20-b92a-585841c1cff4 in Status: SUCCESS [ 943.669563] env[69188]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 199db626-eef5-4a20-b92a-585841c1cff4 deletion is rescheduled due to dependency. [ 943.669676] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-199db626-eef5-4a20-b92a-585841c1cff4" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.671281] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-199db626-eef5-4a20-b92a-585841c1cff4" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.671503] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-199db626-eef5-4a20-b92a-585841c1cff4" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.671692] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.671807] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.671872] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.672083] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.672167] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.672260] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('199db626-eef5-4a20-b92a-585841c1cff4',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 943.861372] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b99e414b-ff9c-4d19-b3c8-32ab58288d75',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 943.894474] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.894925] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.894925] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.895617] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.895617] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.895617] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.895876] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.895876] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.896336] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.896336] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.896336] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3d37bee8-a6a2-465c-be52-6cc5e558ec26 already deleted. [ 943.896336] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3d37bee8-a6a2-465c-be52-6cc5e558ec26" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.021250] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9f2518e8-b195-4520-b262-caa765ab7e27 in Status: SUCCESS [ 944.021513] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9f2518e8-b195-4520-b262-caa765ab7e27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.158034] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e4039e1d-9712-484a-9e32-16f2dc6c2311: rpc.has_security_group_logging(os_id): False [ 944.161735] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e4039e1d-9712-484a-9e32-16f2dc6c2311',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 944.174167] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('199db626-eef5-4a20-b92a-585841c1cff4',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 944.176601] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.176818] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.176818] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.177032] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.195451] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.195765] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.199858] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.199858] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.199858] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.199858] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.199858] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e4039e1d-9712-484a-9e32-16f2dc6c2311 is going to be updated. [ 944.230335] env[69188]: INFO networking_nsxv3.common.synchronization [req-ed5a704e-a9a6-45a4-aa74-574ee485e4c0 req-2daa1d93-ff3c-4b27-ab33-bc1cab1b1df1 tempest-AttachInterfacesUnderV243Test-1529073749 tempest-AttachInterfacesUnderV243Test-1529073749-project-member] Enqueued Resource ID: e4039e1d-9712-484a-9e32-16f2dc6c2311 with Priority: HIGHEST for action security_group_members [ 944.230502] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e4039e1d-9712-484a-9e32-16f2dc6c2311 with Priority: HIGHEST for action security_group_members [ 944.230847] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-e4039e1d-9712-484a-9e32-16f2dc6c2311 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.230971] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e4039e1d-9712-484a-9e32-16f2dc6c2311" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.249765] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.249942] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.250022] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.250241] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.250393] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.262658] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e4039e1d-9712-484a-9e32-16f2dc6c2311 in Status: IN_PROGRESS for 2s [ 944.366283] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.366601] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.366601] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.366976] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.367132] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.367260] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b99e414b-ff9c-4d19-b3c8-32ab58288d75 is going to be updated. [ 944.396398] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.396661] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.396798] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.397050] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.397665] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.406329] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b99e414b-ff9c-4d19-b3c8-32ab58288d75 in Status: IN_PROGRESS for 2s [ 944.665320] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.665639] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.665639] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.665742] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.665911] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.665911] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e4039e1d-9712-484a-9e32-16f2dc6c2311 is going to be updated. [ 944.678774] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('199db626-eef5-4a20-b92a-585841c1cff4',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 944.695909] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.695909] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.695909] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.696080] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.696191] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.704795] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e4039e1d-9712-484a-9e32-16f2dc6c2311 in Status: IN_PROGRESS for 2s [ 945.184559] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.184559] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.184559] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.184559] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.184559] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.184559] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 199db626-eef5-4a20-b92a-585841c1cff4 is going to be updated. [ 945.212338] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.212573] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.212695] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.212966] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.213189] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.221928] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 199db626-eef5-4a20-b92a-585841c1cff4 in Status: IN_PROGRESS for 2s [ 945.628836] env[69188]: INFO networking_nsxv3.common.synchronization [req-241f2344-f5d9-4546-becf-26362e106038 req-332493d7-4e03-4c24-979f-f3ec245f6930 tempest-VolumesAdminNegativeTest-627287247 tempest-VolumesAdminNegativeTest-627287247-project-member] Enqueued Resource ID: a1ea10ba-bdd7-49b6-97a8-01622e70af27 with Priority: HIGHEST for action security_group_members [ 945.629303] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a1ea10ba-bdd7-49b6-97a8-01622e70af27 with Priority: HIGHEST for action security_group_members [ 945.629609] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-a1ea10ba-bdd7-49b6-97a8-01622e70af27 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.629769] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a1ea10ba-bdd7-49b6-97a8-01622e70af27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.629844] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a1ea10ba-bdd7-49b6-97a8-01622e70af27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.630134] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a1ea10ba-bdd7-49b6-97a8-01622e70af27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.630324] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.630434] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.630493] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.630681] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.630774] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.630866] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a1ea10ba-bdd7-49b6-97a8-01622e70af27',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 946.042898] env[69188]: INFO networking_nsxv3.common.synchronization [req-a7d4e182-3d1a-4dad-bce3-42b7c5e312dd req-3207c97c-9b63-4c46-91af-9b938093697a tempest-ServerRescueNegativeTestJSON-1937748911 tempest-ServerRescueNegativeTestJSON-1937748911-project-member] Enqueued Resource ID: fa6e8a6e-b63b-4248-b67b-4ae889fac90c with Priority: HIGHEST for action security_group_members [ 946.043442] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fa6e8a6e-b63b-4248-b67b-4ae889fac90c with Priority: HIGHEST for action security_group_members [ 946.043747] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-fa6e8a6e-b63b-4248-b67b-4ae889fac90c taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.043879] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fa6e8a6e-b63b-4248-b67b-4ae889fac90c" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.043969] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fa6e8a6e-b63b-4248-b67b-4ae889fac90c" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.044245] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fa6e8a6e-b63b-4248-b67b-4ae889fac90c" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.044408] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.044512] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.044568] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.044720] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.044806] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.044900] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fa6e8a6e-b63b-4248-b67b-4ae889fac90c',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 946.135263] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.135450] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.135510] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.135696] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.154821] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.155102] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.155232] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.155288] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.155477] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.155561] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.155650] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a1ea10ba-bdd7-49b6-97a8-01622e70af27 is going to be updated. [ 946.178156] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.178370] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.178370] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.178591] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.178764] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.188661] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a1ea10ba-bdd7-49b6-97a8-01622e70af27 in Status: IN_PROGRESS for 2s [ 946.277201] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e4039e1d-9712-484a-9e32-16f2dc6c2311 in Status: SUCCESS [ 946.277914] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e4039e1d-9712-484a-9e32-16f2dc6c2311" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.277914] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e4039e1d-9712-484a-9e32-16f2dc6c2311" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.277914] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e4039e1d-9712-484a-9e32-16f2dc6c2311" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.277914] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e4039e1d-9712-484a-9e32-16f2dc6c2311',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 946.418519] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b99e414b-ff9c-4d19-b3c8-32ab58288d75 in Status: SUCCESS [ 946.418779] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b99e414b-ff9c-4d19-b3c8-32ab58288d75" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.418957] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b99e414b-ff9c-4d19-b3c8-32ab58288d75" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.419437] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b99e414b-ff9c-4d19-b3c8-32ab58288d75" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.419730] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.419838] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.419894] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.420088] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.420173] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.420261] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b99e414b-ff9c-4d19-b3c8-32ab58288d75" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.420429] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-b99e414b-ff9c-4d19-b3c8-32ab58288d75 taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.420507] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b99e414b-ff9c-4d19-b3c8-32ab58288d75" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.420621] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b99e414b-ff9c-4d19-b3c8-32ab58288d75" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.420722] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b99e414b-ff9c-4d19-b3c8-32ab58288d75" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.420833] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.420938] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.421018] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.421118] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.421195] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.421273] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b99e414b-ff9c-4d19-b3c8-32ab58288d75" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.421358] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b99e414b-ff9c-4d19-b3c8-32ab58288d75',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 946.422222] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b99e414b-ff9c-4d19-b3c8-32ab58288d75" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.425434] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b99e414b-ff9c-4d19-b3c8-32ab58288d75" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.425434] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.425434] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.425434] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.425434] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.425434] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.425434] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b99e414b-ff9c-4d19-b3c8-32ab58288d75',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 946.498218] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock network-578 taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.498218] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "network-578" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.498218] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "network-578" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.500339] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "network-578" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.500339] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.500339] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.500339] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.500339] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.500339] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.500339] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 946.500339] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] NeedRegenerationException {{(pid=69188) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 946.500932] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] no value, waiting for create lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 946.500932] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] value creation lock acquired {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 946.500932] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 946.501124] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Calling creation function for not-yet-present value {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 946.501248] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 946.518360] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 946.518530] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=69188) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 946.519451] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Released creation lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 946.519451] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "network-578" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.519451] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock port-e4fd1b70-ea8a-43f7-9bbd-c33425c71046 taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.519699] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "port-e4fd1b70-ea8a-43f7-9bbd-c33425c71046" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.519699] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "port-e4fd1b70-ea8a-43f7-9bbd-c33425c71046" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.520245] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "port-e4fd1b70-ea8a-43f7-9bbd-c33425c71046" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.520657] env[69188]: DEBUG networking_nsxv3.api.rpc [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e4fd1b70-ea8a-43f7-9bbd-c33425c71046',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 946.552383] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.552698] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.552698] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.552810] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.552881] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.553085] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.553188] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.553239] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.553404] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.553482] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.553571] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fa6e8a6e-b63b-4248-b67b-4ae889fac90c already deleted. [ 946.553652] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fa6e8a6e-b63b-4248-b67b-4ae889fac90c" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.714992] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e4039e1d-9712-484a-9e32-16f2dc6c2311 in Status: SUCCESS [ 946.715231] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e4039e1d-9712-484a-9e32-16f2dc6c2311" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.715408] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e4039e1d-9712-484a-9e32-16f2dc6c2311" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.715613] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e4039e1d-9712-484a-9e32-16f2dc6c2311" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.715831] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.715898] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.715960] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.716173] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.716239] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.716275] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e4039e1d-9712-484a-9e32-16f2dc6c2311',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 946.804597] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.804785] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.804846] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.805029] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.805119] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.805215] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e4039e1d-9712-484a-9e32-16f2dc6c2311 is going to be deleted. [ 946.862685] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.863031] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.863031] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.863133] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.863182] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.863286] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e4039e1d-9712-484a-9e32-16f2dc6c2311" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.926933] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b99e414b-ff9c-4d19-b3c8-32ab58288d75: rpc.has_security_group_logging(os_id): False [ 946.926933] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b99e414b-ff9c-4d19-b3c8-32ab58288d75',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 946.945872] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.946087] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.946183] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.946447] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.974291] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.974586] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.974717] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.974789] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.975013] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.975104] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.975576] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.975701] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.975772] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.975935] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.976024] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.976224] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.976320] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.976382] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.976522] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.976628] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.976732] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b99e414b-ff9c-4d19-b3c8-32ab58288d75 is going to be updated. [ 947.023257] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.023785] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.023946] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.024276] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.024428] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.024586] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Segment Port e4fd1b70-ea8a-43f7-9bbd-c33425c71046 not found, creating... [ 947.024888] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.025063] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.025196] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.025412] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.025548] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.025844] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.025996] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.026561] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.026876] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.027087] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.028224] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Resource: SegmentPort with ID: e4fd1b70-ea8a-43f7-9bbd-c33425c71046 is going to be created. [ 947.049056] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.049388] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.049474] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.049880] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.050189] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.050427] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "port-e4fd1b70-ea8a-43f7-9bbd-c33425c71046" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.052179] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.052344] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.052442] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.052681] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.052825] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.057413] env[69188]: INFO networking_nsxv3.common.synchronization [None req-c4d3884e-a935-4b45-8f9e-54df6f060a91 None None] Enqueued Resource ID: b32b289c-58e0-4c2e-bc6b-82364ae8e04e with Priority: HIGHEST for action port [ 947.061018] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b32b289c-58e0-4c2e-bc6b-82364ae8e04e with Priority: HIGHEST for action port [ 947.061018] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-b32b289c-58e0-4c2e-bc6b-82364ae8e04e taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.061018] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b32b289c-58e0-4c2e-bc6b-82364ae8e04e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.061018] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b32b289c-58e0-4c2e-bc6b-82364ae8e04e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.061018] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b32b289c-58e0-4c2e-bc6b-82364ae8e04e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.061018] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b32b289c-58e0-4c2e-bc6b-82364ae8e04e',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.070955] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b99e414b-ff9c-4d19-b3c8-32ab58288d75 in Status: IN_PROGRESS for 2s [ 947.221318] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.221544] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.221628] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.221877] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.221979] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.222212] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.222344] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.222412] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.222611] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.222725] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.222905] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e4039e1d-9712-484a-9e32-16f2dc6c2311 is going to be deleted. [ 947.241362] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 199db626-eef5-4a20-b92a-585841c1cff4 in Status: SUCCESS [ 947.243115] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-199db626-eef5-4a20-b92a-585841c1cff4" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.243345] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-199db626-eef5-4a20-b92a-585841c1cff4" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.243574] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-199db626-eef5-4a20-b92a-585841c1cff4" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.243766] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.243881] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.243946] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.244117] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.244198] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.244281] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-199db626-eef5-4a20-b92a-585841c1cff4" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.244373] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('199db626-eef5-4a20-b92a-585841c1cff4',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.257274] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.257422] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.257493] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.257703] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.257794] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.257894] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e4039e1d-9712-484a-9e32-16f2dc6c2311" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.258053] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e4039e1d-9712-484a-9e32-16f2dc6c2311" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.258203] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e4039e1d-9712-484a-9e32-16f2dc6c2311" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.258362] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.258458] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.258544] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.258653] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.258842] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.258947] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e4039e1d-9712-484a-9e32-16f2dc6c2311',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.431022] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b99e414b-ff9c-4d19-b3c8-32ab58288d75',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.483295] env[69188]: INFO networking_nsxv3.common.synchronization [req-c415ffde-48d4-4980-8f4e-4c14033f0849 req-9a8a2695-1fd6-461a-9c60-ba572cc30300 tempest-ServersTestJSON-1495057482 tempest-ServersTestJSON-1495057482-project-member] Enqueued Resource ID: 9f2518e8-b195-4520-b262-caa765ab7e27 with Priority: HIGHEST for action security_group_members [ 947.483295] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f2518e8-b195-4520-b262-caa765ab7e27 with Priority: HIGHEST for action security_group_members [ 947.483295] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-9f2518e8-b195-4520-b262-caa765ab7e27 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.483295] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9f2518e8-b195-4520-b262-caa765ab7e27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.483295] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9f2518e8-b195-4520-b262-caa765ab7e27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.483295] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9f2518e8-b195-4520-b262-caa765ab7e27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.483295] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.483295] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.483633] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.483781] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.483920] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.484072] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9f2518e8-b195-4520-b262-caa765ab7e27',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.562990] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b32b289c-58e0-4c2e-bc6b-82364ae8e04e [ 947.563223] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.563355] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.563424] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.563643] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.563738] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.563835] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b32b289c-58e0-4c2e-bc6b-82364ae8e04e already deleted. [ 947.563915] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b32b289c-58e0-4c2e-bc6b-82364ae8e04e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.746826] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-199db626-eef5-4a20-b92a-585841c1cff4 taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.747077] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-199db626-eef5-4a20-b92a-585841c1cff4" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.747149] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-199db626-eef5-4a20-b92a-585841c1cff4" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.747361] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-199db626-eef5-4a20-b92a-585841c1cff4" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.747569] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.747694] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.747821] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.747960] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.748092] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.748198] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-199db626-eef5-4a20-b92a-585841c1cff4" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.748362] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-199db626-eef5-4a20-b92a-585841c1cff4 taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.748451] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-199db626-eef5-4a20-b92a-585841c1cff4" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.748547] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-199db626-eef5-4a20-b92a-585841c1cff4" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.748755] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-199db626-eef5-4a20-b92a-585841c1cff4" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.748903] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.749046] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.749144] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.749259] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.749367] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.749467] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-199db626-eef5-4a20-b92a-585841c1cff4" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.749544] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('199db626-eef5-4a20-b92a-585841c1cff4',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.765456] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.765611] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.765806] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.765909] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.765973] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.766187] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.766284] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.766349] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.766511] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.766708] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.766800] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e4039e1d-9712-484a-9e32-16f2dc6c2311 already deleted. [ 947.766884] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e4039e1d-9712-484a-9e32-16f2dc6c2311" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.933313] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.933469] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.933543] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.933760] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.933850] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.933950] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b99e414b-ff9c-4d19-b3c8-32ab58288d75 is going to be updated. [ 947.967555] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.967823] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.967823] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.967982] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.969114] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.977219] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b99e414b-ff9c-4d19-b3c8-32ab58288d75 in Status: IN_PROGRESS for 2s [ 947.979412] env[69188]: INFO networking_nsxv3.common.synchronization [req-a7d4e182-3d1a-4dad-bce3-42b7c5e312dd req-ffb082b5-a0af-4edf-a715-ba0d4d129fdd service nova] Enqueued Resource ID: fa6e8a6e-b63b-4248-b67b-4ae889fac90c with Priority: HIGHEST for action security_group_rules [ 947.979584] env[69188]: INFO networking_nsxv3.common.synchronization [req-a7d4e182-3d1a-4dad-bce3-42b7c5e312dd req-ffb082b5-a0af-4edf-a715-ba0d4d129fdd service nova] Enqueued Resource ID: fa6e8a6e-b63b-4248-b67b-4ae889fac90c with Priority: HIGHEST for action security_group_members [ 947.979762] env[69188]: INFO networking_nsxv3.common.synchronization [req-a7d4e182-3d1a-4dad-bce3-42b7c5e312dd req-ffb082b5-a0af-4edf-a715-ba0d4d129fdd service nova] Enqueued Resource ID: e4fd1b70-ea8a-43f7-9bbd-c33425c71046 with Priority: HIGHEST for action port [ 947.980031] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fa6e8a6e-b63b-4248-b67b-4ae889fac90c with Priority: HIGHEST for action security_group_rules [ 947.983099] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fa6e8a6e-b63b-4248-b67b-4ae889fac90c with Priority: HIGHEST for action security_group_members [ 947.983099] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e4fd1b70-ea8a-43f7-9bbd-c33425c71046 with Priority: HIGHEST for action port [ 947.983099] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fa6e8a6e-b63b-4248-b67b-4ae889fac90c taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.983099] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fa6e8a6e-b63b-4248-b67b-4ae889fac90c" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.983099] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fa6e8a6e-b63b-4248-b67b-4ae889fac90c" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.983099] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fa6e8a6e-b63b-4248-b67b-4ae889fac90c" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.983099] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fa6e8a6e-b63b-4248-b67b-4ae889fac90c',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.983099] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-fa6e8a6e-b63b-4248-b67b-4ae889fac90c taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.983099] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fa6e8a6e-b63b-4248-b67b-4ae889fac90c" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.983760] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fa6e8a6e-b63b-4248-b67b-4ae889fac90c" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.983760] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fa6e8a6e-b63b-4248-b67b-4ae889fac90c" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.983760] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.983760] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.983760] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.983760] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.984039] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.984039] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fa6e8a6e-b63b-4248-b67b-4ae889fac90c',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.984642] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-e4fd1b70-ea8a-43f7-9bbd-c33425c71046 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.984753] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e4fd1b70-ea8a-43f7-9bbd-c33425c71046" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.984814] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e4fd1b70-ea8a-43f7-9bbd-c33425c71046" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.985040] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e4fd1b70-ea8a-43f7-9bbd-c33425c71046" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.985091] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e4fd1b70-ea8a-43f7-9bbd-c33425c71046',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.989804] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9f2518e8-b195-4520-b262-caa765ab7e27',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.198651] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a1ea10ba-bdd7-49b6-97a8-01622e70af27 in Status: SUCCESS [ 948.199070] env[69188]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a1ea10ba-bdd7-49b6-97a8-01622e70af27 deletion is rescheduled due to dependency. [ 948.199070] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a1ea10ba-bdd7-49b6-97a8-01622e70af27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.252787] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 199db626-eef5-4a20-b92a-585841c1cff4: rpc.has_security_group_logging(os_id): False [ 948.280641] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.280781] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.280857] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.281110] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.301783] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.302047] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.302582] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.302582] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.302582] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.302582] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.302757] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.302806] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.302870] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.303031] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.303109] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.303286] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.303379] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.303440] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.303581] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.304437] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.304437] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 199db626-eef5-4a20-b92a-585841c1cff4 is going to be updated. [ 948.367031] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.367031] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.367031] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.367031] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.367031] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.415601] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 199db626-eef5-4a20-b92a-585841c1cff4 in Status: IN_PROGRESS for 2s [ 948.490489] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e4fd1b70-ea8a-43f7-9bbd-c33425c71046 with status ACTIVE [ 948.490489] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.490489] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.490489] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.490489] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.490489] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.490489] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.490489] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.490489] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.490489] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.490489] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.490489] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.490968] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.490968] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.490968] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.490968] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.490968] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e4fd1b70-ea8a-43f7-9bbd-c33425c71046 is going to be updated. [ 948.492248] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fa6e8a6e-b63b-4248-b67b-4ae889fac90c',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.493455] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-fa6e8a6e-b63b-4248-b67b-4ae889fac90c taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.493572] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fa6e8a6e-b63b-4248-b67b-4ae889fac90c" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.493932] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9f2518e8-b195-4520-b262-caa765ab7e27',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.516154] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.516315] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.516995] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.516995] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.516995] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.516995] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e4fd1b70-ea8a-43f7-9bbd-c33425c71046" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.785446] env[69188]: INFO networking_nsxv3.common.synchronization [req-0aa08e3c-bd72-4daf-989d-9abac41670cb req-09599220-46d8-4248-8f0f-83a464b1dc06 tempest-ServerRescueNegativeTestJSON-1937748911 tempest-ServerRescueNegativeTestJSON-1937748911-project-member] Enqueued Resource ID: fa6e8a6e-b63b-4248-b67b-4ae889fac90c with Priority: HIGHEST for action security_group_members [ 948.786102] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fa6e8a6e-b63b-4248-b67b-4ae889fac90c with Priority: HIGHEST for action security_group_members [ 948.786441] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-fa6e8a6e-b63b-4248-b67b-4ae889fac90c taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.786551] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fa6e8a6e-b63b-4248-b67b-4ae889fac90c" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.820102] env[69188]: INFO networking_nsxv3.common.synchronization [None req-6d3d6289-f4b6-4475-a3d5-ae1a07139e61 None None] Enqueued Resource ID: e61a88ff-21b0-4e9d-928d-15e6cca25323 with Priority: HIGHEST for action port [ 948.820644] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e61a88ff-21b0-4e9d-928d-15e6cca25323 with Priority: HIGHEST for action port [ 948.821023] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-e61a88ff-21b0-4e9d-928d-15e6cca25323 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.821469] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e61a88ff-21b0-4e9d-928d-15e6cca25323" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.821469] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e61a88ff-21b0-4e9d-928d-15e6cca25323" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.821469] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e61a88ff-21b0-4e9d-928d-15e6cca25323" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.821621] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e61a88ff-21b0-4e9d-928d-15e6cca25323',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.994459] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fa6e8a6e-b63b-4248-b67b-4ae889fac90c',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.997709] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.997843] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.997914] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.998139] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.998375] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.998375] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9f2518e8-b195-4520-b262-caa765ab7e27 is going to be updated. [ 949.026254] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.026254] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.026254] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.028195] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.030184] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.039900] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9f2518e8-b195-4520-b262-caa765ab7e27 in Status: IN_PROGRESS for 2s [ 949.088656] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b99e414b-ff9c-4d19-b3c8-32ab58288d75 in Status: SUCCESS [ 949.088656] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b99e414b-ff9c-4d19-b3c8-32ab58288d75" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.088656] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b99e414b-ff9c-4d19-b3c8-32ab58288d75" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.088656] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b99e414b-ff9c-4d19-b3c8-32ab58288d75" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.088656] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b99e414b-ff9c-4d19-b3c8-32ab58288d75',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 949.198520] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock network-578 taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.198741] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "network-578" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.199073] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "network-578" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.199152] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "network-578" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.199415] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.199574] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.199697] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.199923] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.200595] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.201545] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 949.201545] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] NeedRegenerationException {{(pid=69188) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 949.201545] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] no value, waiting for create lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 949.201545] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] value creation lock acquired {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 949.201545] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 949.201545] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Calling creation function for not-yet-present value {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 949.201834] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 949.219081] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 949.219490] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69188) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 949.219490] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Released creation lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 949.219604] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "network-578" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.219871] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock port-2bd5645f-c013-434b-a889-506df9758f0c taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.220057] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "port-2bd5645f-c013-434b-a889-506df9758f0c" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.220186] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "port-2bd5645f-c013-434b-a889-506df9758f0c" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.222578] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "port-2bd5645f-c013-434b-a889-506df9758f0c" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.222578] env[69188]: DEBUG networking_nsxv3.api.rpc [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2bd5645f-c013-434b-a889-506df9758f0c',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 949.324987] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e61a88ff-21b0-4e9d-928d-15e6cca25323 [ 949.325278] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.325439] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.325511] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.325755] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.325881] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.325988] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e61a88ff-21b0-4e9d-928d-15e6cca25323 already deleted. [ 949.326097] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e61a88ff-21b0-4e9d-928d-15e6cca25323" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.498811] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.499143] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.499143] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.499399] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.499516] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.500359] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fa6e8a6e-b63b-4248-b67b-4ae889fac90c is going to be created. [ 949.524107] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.524267] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.524361] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.524547] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.524750] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.534209] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fa6e8a6e-b63b-4248-b67b-4ae889fac90c in Status: UNINITIALIZED for 2s [ 949.591043] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-b99e414b-ff9c-4d19-b3c8-32ab58288d75 taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.591348] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b99e414b-ff9c-4d19-b3c8-32ab58288d75" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.725902] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.726202] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.726342] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.726636] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.726928] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.727046] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Segment Port 2bd5645f-c013-434b-a889-506df9758f0c not found, creating... [ 949.727281] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.727451] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.727572] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.727806] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.728056] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.728250] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.728406] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.728566] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.728744] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.728905] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.733167] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Resource: SegmentPort with ID: 2bd5645f-c013-434b-a889-506df9758f0c is going to be created. [ 949.765230] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.765230] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.765230] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.765230] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.765230] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.765230] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "port-2bd5645f-c013-434b-a889-506df9758f0c" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.988466] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b99e414b-ff9c-4d19-b3c8-32ab58288d75 in Status: SUCCESS [ 949.988788] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b99e414b-ff9c-4d19-b3c8-32ab58288d75" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.989077] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b99e414b-ff9c-4d19-b3c8-32ab58288d75" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.989338] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b99e414b-ff9c-4d19-b3c8-32ab58288d75" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.989570] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.989885] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.990056] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.990266] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.990369] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.990444] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b99e414b-ff9c-4d19-b3c8-32ab58288d75" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.990647] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b99e414b-ff9c-4d19-b3c8-32ab58288d75',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 950.185079] env[69188]: INFO networking_nsxv3.common.synchronization [None req-c417d69e-65d4-494c-929b-6e37ea9c5eb1 None None] Enqueued Resource ID: 854614f9-feef-450c-992f-44a4fe614086 with Priority: HIGHEST for action port [ 950.186409] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 854614f9-feef-450c-992f-44a4fe614086 with Priority: HIGHEST for action port [ 950.186745] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-854614f9-feef-450c-992f-44a4fe614086 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.186936] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-854614f9-feef-450c-992f-44a4fe614086" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.187073] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-854614f9-feef-450c-992f-44a4fe614086" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.187440] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-854614f9-feef-450c-992f-44a4fe614086" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.187560] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('854614f9-feef-450c-992f-44a4fe614086',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 950.445157] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 199db626-eef5-4a20-b92a-585841c1cff4 in Status: SUCCESS [ 950.445157] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-199db626-eef5-4a20-b92a-585841c1cff4" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.494748] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-b99e414b-ff9c-4d19-b3c8-32ab58288d75 taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.494748] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b99e414b-ff9c-4d19-b3c8-32ab58288d75" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.494748] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b99e414b-ff9c-4d19-b3c8-32ab58288d75" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.494748] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b99e414b-ff9c-4d19-b3c8-32ab58288d75" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.494748] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.494748] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.494748] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.494748] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.495274] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.495274] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b99e414b-ff9c-4d19-b3c8-32ab58288d75" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.497819] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-b99e414b-ff9c-4d19-b3c8-32ab58288d75 taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.497819] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b99e414b-ff9c-4d19-b3c8-32ab58288d75" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.497819] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b99e414b-ff9c-4d19-b3c8-32ab58288d75" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.497819] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b99e414b-ff9c-4d19-b3c8-32ab58288d75" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.497819] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.497819] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.497819] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.497819] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.497819] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.497819] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b99e414b-ff9c-4d19-b3c8-32ab58288d75" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.497819] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b99e414b-ff9c-4d19-b3c8-32ab58288d75',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 950.693277] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 854614f9-feef-450c-992f-44a4fe614086 [ 950.695413] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.695413] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.695413] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.695413] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.695413] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.695413] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:854614f9-feef-450c-992f-44a4fe614086 already deleted. [ 950.695413] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-854614f9-feef-450c-992f-44a4fe614086" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.811209] env[69188]: INFO networking_nsxv3.common.synchronization [req-0aa08e3c-bd72-4daf-989d-9abac41670cb req-9f4aef5a-bf2a-492c-8d9f-5507f943353d service nova] Enqueued Resource ID: fa6e8a6e-b63b-4248-b67b-4ae889fac90c with Priority: HIGHEST for action security_group_rules [ 950.811389] env[69188]: INFO networking_nsxv3.common.synchronization [req-0aa08e3c-bd72-4daf-989d-9abac41670cb req-9f4aef5a-bf2a-492c-8d9f-5507f943353d service nova] Enqueued Resource ID: fa6e8a6e-b63b-4248-b67b-4ae889fac90c with Priority: HIGHEST for action security_group_members [ 950.811534] env[69188]: INFO networking_nsxv3.common.synchronization [req-0aa08e3c-bd72-4daf-989d-9abac41670cb req-9f4aef5a-bf2a-492c-8d9f-5507f943353d service nova] Enqueued Resource ID: 2bd5645f-c013-434b-a889-506df9758f0c with Priority: HIGHEST for action port [ 950.816131] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fa6e8a6e-b63b-4248-b67b-4ae889fac90c with Priority: HIGHEST for action security_group_rules [ 950.816315] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fa6e8a6e-b63b-4248-b67b-4ae889fac90c with Priority: HIGHEST for action security_group_members [ 950.816423] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2bd5645f-c013-434b-a889-506df9758f0c with Priority: HIGHEST for action port [ 950.817059] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fa6e8a6e-b63b-4248-b67b-4ae889fac90c taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.817148] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fa6e8a6e-b63b-4248-b67b-4ae889fac90c" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.817373] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-fa6e8a6e-b63b-4248-b67b-4ae889fac90c taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.817458] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fa6e8a6e-b63b-4248-b67b-4ae889fac90c" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.817638] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-2bd5645f-c013-434b-a889-506df9758f0c taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.817739] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2bd5645f-c013-434b-a889-506df9758f0c" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.817806] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2bd5645f-c013-434b-a889-506df9758f0c" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.818012] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2bd5645f-c013-434b-a889-506df9758f0c" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.818093] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2bd5645f-c013-434b-a889-506df9758f0c',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 950.999007] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b99e414b-ff9c-4d19-b3c8-32ab58288d75: rpc.has_security_group_logging(os_id): False [ 951.017317] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.017435] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.017502] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.017720] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.017814] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.018036] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.018136] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.018211] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.018431] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.018499] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.018689] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.018803] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.018869] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.019020] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.019097] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.019274] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.019366] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.019469] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.019558] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.019647] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.019744] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b99e414b-ff9c-4d19-b3c8-32ab58288d75 is going to be updated. [ 951.045133] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9f2518e8-b195-4520-b262-caa765ab7e27 in Status: SUCCESS [ 951.045369] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9f2518e8-b195-4520-b262-caa765ab7e27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.077677] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.077677] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.077677] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.077805] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.078055] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.095086] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b99e414b-ff9c-4d19-b3c8-32ab58288d75 in Status: IN_PROGRESS for 2s [ 951.321743] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2bd5645f-c013-434b-a889-506df9758f0c with status ACTIVE [ 951.321743] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.321743] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.321743] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.321743] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.321743] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.321743] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.322455] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.322455] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.322455] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.322455] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.322455] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.322455] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.322455] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.322813] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.322813] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.322813] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2bd5645f-c013-434b-a889-506df9758f0c is going to be updated. [ 951.342687] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.342861] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.342909] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.343160] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.343305] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.344028] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2bd5645f-c013-434b-a889-506df9758f0c" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.555073] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fa6e8a6e-b63b-4248-b67b-4ae889fac90c in Status: SUCCESS [ 951.555395] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fa6e8a6e-b63b-4248-b67b-4ae889fac90c" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.555583] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fa6e8a6e-b63b-4248-b67b-4ae889fac90c" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.555817] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fa6e8a6e-b63b-4248-b67b-4ae889fac90c" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.556595] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.556595] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.556595] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.556595] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.556595] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.556595] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fa6e8a6e-b63b-4248-b67b-4ae889fac90c" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.556873] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fa6e8a6e-b63b-4248-b67b-4ae889fac90c',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.560272] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fa6e8a6e-b63b-4248-b67b-4ae889fac90c" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.560272] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fa6e8a6e-b63b-4248-b67b-4ae889fac90c" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.560272] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.560272] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.560272] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.560272] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.560272] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.560272] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fa6e8a6e-b63b-4248-b67b-4ae889fac90c',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 952.063471] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-fa6e8a6e-b63b-4248-b67b-4ae889fac90c taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.063471] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fa6e8a6e-b63b-4248-b67b-4ae889fac90c" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.067773] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fa6e8a6e-b63b-4248-b67b-4ae889fac90c',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 952.400552] env[69188]: INFO networking_nsxv3.common.synchronization [None req-5804a1dd-7142-415c-aa2f-ba43e7fed320 None None] Enqueued Resource ID: 31fdafe9-7b44-4d8c-a70c-846813be2313 with Priority: HIGHEST for action port [ 952.400552] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 31fdafe9-7b44-4d8c-a70c-846813be2313 with Priority: HIGHEST for action port [ 952.400552] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-31fdafe9-7b44-4d8c-a70c-846813be2313 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.400552] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-31fdafe9-7b44-4d8c-a70c-846813be2313" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.400552] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-31fdafe9-7b44-4d8c-a70c-846813be2313" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.400552] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-31fdafe9-7b44-4d8c-a70c-846813be2313" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.400552] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('31fdafe9-7b44-4d8c-a70c-846813be2313',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 952.569247] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fa6e8a6e-b63b-4248-b67b-4ae889fac90c',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 952.902033] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 31fdafe9-7b44-4d8c-a70c-846813be2313 [ 952.902033] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.902192] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.902192] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.902422] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.902547] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.902684] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:31fdafe9-7b44-4d8c-a70c-846813be2313 already deleted. [ 952.902751] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-31fdafe9-7b44-4d8c-a70c-846813be2313" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.072612] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.072789] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.072886] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.073240] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.073361] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.073496] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fa6e8a6e-b63b-4248-b67b-4ae889fac90c is going to be updated. [ 953.111333] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b99e414b-ff9c-4d19-b3c8-32ab58288d75 in Status: SUCCESS [ 953.111559] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b99e414b-ff9c-4d19-b3c8-32ab58288d75" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.112547] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.112687] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.112778] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.112997] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.113152] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.121141] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fa6e8a6e-b63b-4248-b67b-4ae889fac90c in Status: IN_PROGRESS for 2s [ 953.925568] env[69188]: INFO networking_nsxv3.common.synchronization [req-f113dc1f-6cdf-4b2e-9124-a03b31c8f491 req-3ba391d6-4ed9-47b1-bff4-f8b2bec9bceb tempest-ListImageFiltersTestJSON-1208479351 tempest-ListImageFiltersTestJSON-1208479351-project-member] Enqueued Resource ID: e6233127-d754-46c4-9840-1e77714a63d1 with Priority: HIGHEST for action security_group_members [ 953.925568] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e6233127-d754-46c4-9840-1e77714a63d1 with Priority: HIGHEST for action security_group_members [ 953.925857] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-e6233127-d754-46c4-9840-1e77714a63d1 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.925857] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e6233127-d754-46c4-9840-1e77714a63d1" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.926026] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e6233127-d754-46c4-9840-1e77714a63d1" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.927281] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e6233127-d754-46c4-9840-1e77714a63d1" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.927460] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.927571] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.927635] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.927803] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.927899] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.928095] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e6233127-d754-46c4-9840-1e77714a63d1',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.432096] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.432280] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.432313] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.432552] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.454181] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.454480] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.454616] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.454679] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.454890] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.455593] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.455593] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e6233127-d754-46c4-9840-1e77714a63d1 is going to be updated. [ 954.506839] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.506839] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.506839] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.506839] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.507032] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.520221] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e6233127-d754-46c4-9840-1e77714a63d1 in Status: IN_PROGRESS for 2s [ 955.131012] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fa6e8a6e-b63b-4248-b67b-4ae889fac90c in Status: SUCCESS [ 955.131378] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fa6e8a6e-b63b-4248-b67b-4ae889fac90c" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.131444] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fa6e8a6e-b63b-4248-b67b-4ae889fac90c" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.131651] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fa6e8a6e-b63b-4248-b67b-4ae889fac90c" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.131846] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.131964] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.132059] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.132213] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.132280] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.132378] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fa6e8a6e-b63b-4248-b67b-4ae889fac90c',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 955.416000] env[69188]: INFO networking_nsxv3.common.synchronization [req-9ec169f7-b606-43e9-9f75-f58c44f6905e req-22b0add5-180b-47a1-b7b4-63dd958546c0 tempest-ServerActionsV293TestJSON-1161713519 tempest-ServerActionsV293TestJSON-1161713519-project-member] Enqueued Resource ID: 8f01fd17-613c-4bd7-9c6b-8b39ac58be72 with Priority: HIGHEST for action security_group_members [ 955.416259] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f01fd17-613c-4bd7-9c6b-8b39ac58be72 with Priority: HIGHEST for action security_group_members [ 955.418077] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-8f01fd17-613c-4bd7-9c6b-8b39ac58be72 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.418077] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8f01fd17-613c-4bd7-9c6b-8b39ac58be72" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.418077] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8f01fd17-613c-4bd7-9c6b-8b39ac58be72" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.418077] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8f01fd17-613c-4bd7-9c6b-8b39ac58be72" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.418299] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.418299] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.418383] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.418515] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.418934] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.419164] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8f01fd17-613c-4bd7-9c6b-8b39ac58be72',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 955.637991] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fa6e8a6e-b63b-4248-b67b-4ae889fac90c',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 955.923065] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.923232] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.923305] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.923657] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.943606] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.944463] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.944608] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.944681] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.944880] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.944968] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.945148] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8f01fd17-613c-4bd7-9c6b-8b39ac58be72 is going to be updated. [ 955.971079] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.971321] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.971321] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.971473] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.971611] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.980938] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8f01fd17-613c-4bd7-9c6b-8b39ac58be72 in Status: IN_PROGRESS for 2s [ 956.144222] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fa6e8a6e-b63b-4248-b67b-4ae889fac90c',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 956.532498] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e6233127-d754-46c4-9840-1e77714a63d1 in Status: SUCCESS [ 956.532714] env[69188]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e6233127-d754-46c4-9840-1e77714a63d1 deletion is rescheduled due to dependency. [ 956.532714] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e6233127-d754-46c4-9840-1e77714a63d1" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.571349] env[69188]: INFO networking_nsxv3.common.synchronization [req-bc564ee3-663d-400a-aa3e-c86b44479979 req-4d997751-fd1d-4aee-9f08-c1a3b5912be7 tempest-InstanceActionsTestJSON-2066681535 tempest-InstanceActionsTestJSON-2066681535-project-member] Enqueued Resource ID: 721e26e3-d896-46ab-b5a3-92852a365813 with Priority: HIGHEST for action security_group_members [ 956.571744] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 721e26e3-d896-46ab-b5a3-92852a365813 with Priority: HIGHEST for action security_group_members [ 956.572065] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-721e26e3-d896-46ab-b5a3-92852a365813 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.572208] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-721e26e3-d896-46ab-b5a3-92852a365813" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.572288] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-721e26e3-d896-46ab-b5a3-92852a365813" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.572520] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-721e26e3-d896-46ab-b5a3-92852a365813" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.573483] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.573483] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.573483] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.573483] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.573483] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.573483] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('721e26e3-d896-46ab-b5a3-92852a365813',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 956.646718] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.646916] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.647048] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.647193] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.647291] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.647408] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fa6e8a6e-b63b-4248-b67b-4ae889fac90c is going to be updated. [ 956.672813] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.672813] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.672813] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.676223] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.676223] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.680874] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fa6e8a6e-b63b-4248-b67b-4ae889fac90c in Status: IN_PROGRESS for 2s [ 957.076040] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.076040] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.076040] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.076040] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.076040] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.076040] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.076512] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.076512] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.076704] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.076885] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.076980] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 721e26e3-d896-46ab-b5a3-92852a365813 already deleted. [ 957.077082] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-721e26e3-d896-46ab-b5a3-92852a365813" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.372166] env[69188]: INFO networking_nsxv3.common.synchronization [req-8c3d0aff-85e8-428f-a1f0-c07f95840fa7 req-1b01b055-f69b-4f7e-8a4e-7be38b3c1dec tempest-ServersAdminTestJSON-1988649207 tempest-ServersAdminTestJSON-1988649207-project-member] Enqueued Resource ID: 5e76d42e-7ec6-4a5e-aa9c-c5a285d62318 with Priority: HIGHEST for action security_group_members [ 957.372439] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e76d42e-7ec6-4a5e-aa9c-c5a285d62318 with Priority: HIGHEST for action security_group_members [ 957.373596] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e76d42e-7ec6-4a5e-aa9c-c5a285d62318 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.373596] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e76d42e-7ec6-4a5e-aa9c-c5a285d62318" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.373596] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e76d42e-7ec6-4a5e-aa9c-c5a285d62318" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.379018] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e76d42e-7ec6-4a5e-aa9c-c5a285d62318" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.379018] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.379018] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.379018] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.379018] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.379018] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.379018] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5e76d42e-7ec6-4a5e-aa9c-c5a285d62318',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 957.541169] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock network-940 taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.541406] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "network-940" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.541534] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "network-940" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.541863] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "network-940" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.542162] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.543979] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.543979] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.543979] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.543979] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.543979] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 957.543979] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] NeedRegenerationException {{(pid=69188) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 957.543979] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] no value, waiting for create lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 957.543979] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] value creation lock acquired {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 957.544673] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 957.544673] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Calling creation function for not-yet-present value {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 957.544673] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 957.568990] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 957.569208] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=69188) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 957.569352] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Released creation lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 957.569541] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "network-940" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.569912] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock port-33cd98d7-219b-4fdd-b1e1-9ffcbd8af598 taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.570135] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "port-33cd98d7-219b-4fdd-b1e1-9ffcbd8af598" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.570297] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "port-33cd98d7-219b-4fdd-b1e1-9ffcbd8af598" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.570644] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "port-33cd98d7-219b-4fdd-b1e1-9ffcbd8af598" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.571150] env[69188]: DEBUG networking_nsxv3.api.rpc [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('33cd98d7-219b-4fdd-b1e1-9ffcbd8af598',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 957.881178] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5e76d42e-7ec6-4a5e-aa9c-c5a285d62318',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 957.995141] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8f01fd17-613c-4bd7-9c6b-8b39ac58be72 in Status: SUCCESS [ 957.995407] env[69188]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8f01fd17-613c-4bd7-9c6b-8b39ac58be72 deletion is rescheduled due to dependency. [ 957.995548] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8f01fd17-613c-4bd7-9c6b-8b39ac58be72" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.074800] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.074800] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.074800] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.075061] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.075393] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.075703] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Segment Port 33cd98d7-219b-4fdd-b1e1-9ffcbd8af598 not found, creating... [ 958.077454] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.077454] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.077454] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.077454] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.077454] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.077828] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.078026] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.078709] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.078821] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.079080] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.079267] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Resource: SegmentPort with ID: 33cd98d7-219b-4fdd-b1e1-9ffcbd8af598 is going to be created. [ 958.100525] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.100829] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.101722] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.101722] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.101722] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.101875] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "port-33cd98d7-219b-4fdd-b1e1-9ffcbd8af598" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.384084] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5e76d42e-7ec6-4a5e-aa9c-c5a285d62318',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 958.690402] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fa6e8a6e-b63b-4248-b67b-4ae889fac90c in Status: SUCCESS [ 958.690632] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fa6e8a6e-b63b-4248-b67b-4ae889fac90c" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.690803] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fa6e8a6e-b63b-4248-b67b-4ae889fac90c" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.691045] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fa6e8a6e-b63b-4248-b67b-4ae889fac90c" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.691239] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.691367] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.691427] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.691639] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.691639] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.691767] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fa6e8a6e-b63b-4248-b67b-4ae889fac90c" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.691873] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-fa6e8a6e-b63b-4248-b67b-4ae889fac90c taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.691969] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fa6e8a6e-b63b-4248-b67b-4ae889fac90c" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.692023] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fa6e8a6e-b63b-4248-b67b-4ae889fac90c" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.692170] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fa6e8a6e-b63b-4248-b67b-4ae889fac90c" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.692320] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.692420] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.692476] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.692595] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.692667] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.692742] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fa6e8a6e-b63b-4248-b67b-4ae889fac90c" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.692831] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fa6e8a6e-b63b-4248-b67b-4ae889fac90c',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 958.888624] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.888851] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.888945] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.889261] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.889372] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.889476] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5e76d42e-7ec6-4a5e-aa9c-c5a285d62318 is going to be updated. [ 958.916244] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.916386] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.916467] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.916687] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.916836] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.924515] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5e76d42e-7ec6-4a5e-aa9c-c5a285d62318 in Status: IN_PROGRESS for 2s [ 959.195086] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fa6e8a6e-b63b-4248-b67b-4ae889fac90c: rpc.has_security_group_logging(os_id): False [ 959.213076] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.213076] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.213076] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.213076] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.213076] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.213076] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.213076] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.213651] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.213651] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.213651] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.213651] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.213651] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.213992] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.213992] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.213992] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.214671] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.214671] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.214671] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.214671] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.214671] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.214937] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fa6e8a6e-b63b-4248-b67b-4ae889fac90c is going to be created. [ 959.266652] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.267282] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.269058] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.269058] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.269058] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.281194] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fa6e8a6e-b63b-4248-b67b-4ae889fac90c in Status: IN_PROGRESS for 2s [ 959.482700] env[69188]: INFO networking_nsxv3.common.synchronization [req-bc564ee3-663d-400a-aa3e-c86b44479979 req-0a65338b-55a2-4f2a-aa0e-dede201cd6f7 service nova] Enqueued Resource ID: 721e26e3-d896-46ab-b5a3-92852a365813 with Priority: HIGHEST for action security_group_rules [ 959.482700] env[69188]: INFO networking_nsxv3.common.synchronization [req-bc564ee3-663d-400a-aa3e-c86b44479979 req-0a65338b-55a2-4f2a-aa0e-dede201cd6f7 service nova] Enqueued Resource ID: 721e26e3-d896-46ab-b5a3-92852a365813 with Priority: HIGHEST for action security_group_members [ 959.483079] env[69188]: INFO networking_nsxv3.common.synchronization [req-bc564ee3-663d-400a-aa3e-c86b44479979 req-0a65338b-55a2-4f2a-aa0e-dede201cd6f7 service nova] Enqueued Resource ID: 33cd98d7-219b-4fdd-b1e1-9ffcbd8af598 with Priority: HIGHEST for action port [ 959.483741] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 721e26e3-d896-46ab-b5a3-92852a365813 with Priority: HIGHEST for action security_group_rules [ 959.483984] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 721e26e3-d896-46ab-b5a3-92852a365813 with Priority: HIGHEST for action security_group_members [ 959.484267] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 33cd98d7-219b-4fdd-b1e1-9ffcbd8af598 with Priority: HIGHEST for action port [ 959.484726] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-721e26e3-d896-46ab-b5a3-92852a365813 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.485326] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-721e26e3-d896-46ab-b5a3-92852a365813" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.485474] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-721e26e3-d896-46ab-b5a3-92852a365813" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.485899] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-721e26e3-d896-46ab-b5a3-92852a365813" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.486112] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('721e26e3-d896-46ab-b5a3-92852a365813',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 959.487530] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-721e26e3-d896-46ab-b5a3-92852a365813 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.491010] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-721e26e3-d896-46ab-b5a3-92852a365813" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.491010] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-721e26e3-d896-46ab-b5a3-92852a365813" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.491010] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-721e26e3-d896-46ab-b5a3-92852a365813" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.491010] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.491010] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.491010] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.491010] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.491010] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.491010] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('721e26e3-d896-46ab-b5a3-92852a365813',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 959.492392] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-33cd98d7-219b-4fdd-b1e1-9ffcbd8af598 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.492520] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-33cd98d7-219b-4fdd-b1e1-9ffcbd8af598" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.492586] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-33cd98d7-219b-4fdd-b1e1-9ffcbd8af598" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.492807] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-33cd98d7-219b-4fdd-b1e1-9ffcbd8af598" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.492969] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('33cd98d7-219b-4fdd-b1e1-9ffcbd8af598',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 959.593442] env[69188]: INFO networking_nsxv3.common.synchronization [req-e617a988-2825-4c05-92f2-c51b615af3c8 req-7b7f3fc6-c6bf-47a2-a73c-cbda3b6a4d2e tempest-ServerDiagnosticsTest-1385495615 tempest-ServerDiagnosticsTest-1385495615-project-member] Enqueued Resource ID: 870d4230-10cb-4ebd-8d12-34aaae29ea98 with Priority: HIGHEST for action security_group_members [ 959.594349] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 870d4230-10cb-4ebd-8d12-34aaae29ea98 with Priority: HIGHEST for action security_group_members [ 959.594782] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-870d4230-10cb-4ebd-8d12-34aaae29ea98 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.594782] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-870d4230-10cb-4ebd-8d12-34aaae29ea98" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.594925] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-870d4230-10cb-4ebd-8d12-34aaae29ea98" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.595345] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-870d4230-10cb-4ebd-8d12-34aaae29ea98" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.595550] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.595640] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.595695] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.595863] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.595938] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.596042] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('870d4230-10cb-4ebd-8d12-34aaae29ea98',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 959.995408] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('721e26e3-d896-46ab-b5a3-92852a365813',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 959.998510] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-721e26e3-d896-46ab-b5a3-92852a365813 taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.998761] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-721e26e3-d896-46ab-b5a3-92852a365813" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.999406] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 33cd98d7-219b-4fdd-b1e1-9ffcbd8af598 with status ACTIVE [ 959.999947] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.000085] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.000161] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.002920] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.002920] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.002920] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.002920] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.002920] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.002920] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.002920] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.002920] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.002920] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.002920] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.002920] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.002920] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.002920] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 33cd98d7-219b-4fdd-b1e1-9ffcbd8af598 is going to be updated. [ 960.027366] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.027366] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.027366] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.027366] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.027366] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.027946] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-33cd98d7-219b-4fdd-b1e1-9ffcbd8af598" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.031576] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock network-267 taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.033462] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "network-267" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.033462] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "network-267" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.033462] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "network-267" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.033462] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.033462] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.033462] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.036222] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.036222] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.036222] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 960.036222] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] NeedRegenerationException {{(pid=69188) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 960.036222] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] no value, waiting for create lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 960.036222] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] value creation lock acquired {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 960.036222] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 960.036222] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Calling creation function for not-yet-present value {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 960.036222] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 960.057227] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 960.057227] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69188) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 960.057512] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Released creation lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 960.057668] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "network-267" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.058060] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock port-1bdd77f8-26f3-4582-a1eb-5ddb74d10e0c taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.058316] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "port-1bdd77f8-26f3-4582-a1eb-5ddb74d10e0c" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.058494] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "port-1bdd77f8-26f3-4582-a1eb-5ddb74d10e0c" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.058927] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "port-1bdd77f8-26f3-4582-a1eb-5ddb74d10e0c" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.059924] env[69188]: DEBUG networking_nsxv3.api.rpc [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1bdd77f8-26f3-4582-a1eb-5ddb74d10e0c',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.100405] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.100606] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.100725] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.100996] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.101139] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.101364] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.101508] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.101648] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.101819] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.102451] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.102451] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 870d4230-10cb-4ebd-8d12-34aaae29ea98 already deleted. [ 960.102451] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-870d4230-10cb-4ebd-8d12-34aaae29ea98" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.499056] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('721e26e3-d896-46ab-b5a3-92852a365813',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.562740] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.563044] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.563226] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.563626] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.563843] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.564031] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Segment Port 1bdd77f8-26f3-4582-a1eb-5ddb74d10e0c not found, creating... [ 960.564313] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.564474] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.564594] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.564852] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.565040] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.565336] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.565493] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.565614] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.565840] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.565993] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.566401] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Resource: SegmentPort with ID: 1bdd77f8-26f3-4582-a1eb-5ddb74d10e0c is going to be created. [ 960.589419] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.589647] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.589792] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.590101] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.590375] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.590766] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "port-1bdd77f8-26f3-4582-a1eb-5ddb74d10e0c" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.935406] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5e76d42e-7ec6-4a5e-aa9c-c5a285d62318 in Status: SUCCESS [ 960.935600] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e76d42e-7ec6-4a5e-aa9c-c5a285d62318" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.001434] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.001590] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.001690] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.001879] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.001971] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.002081] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 721e26e3-d896-46ab-b5a3-92852a365813 is going to be created. [ 961.023359] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.023501] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.023571] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.023783] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.024166] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.033170] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 721e26e3-d896-46ab-b5a3-92852a365813 in Status: UNINITIALIZED for 2s [ 961.293784] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fa6e8a6e-b63b-4248-b67b-4ae889fac90c in Status: SUCCESS [ 961.294093] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fa6e8a6e-b63b-4248-b67b-4ae889fac90c" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.294279] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fa6e8a6e-b63b-4248-b67b-4ae889fac90c" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.294533] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fa6e8a6e-b63b-4248-b67b-4ae889fac90c" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.294611] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fa6e8a6e-b63b-4248-b67b-4ae889fac90c',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 961.355285] env[69188]: INFO networking_nsxv3.common.synchronization [req-e617a988-2825-4c05-92f2-c51b615af3c8 req-37c27522-2926-439f-8e64-5fa885eae263 service nova] Enqueued Resource ID: 870d4230-10cb-4ebd-8d12-34aaae29ea98 with Priority: HIGHEST for action security_group_rules [ 961.355510] env[69188]: INFO networking_nsxv3.common.synchronization [req-e617a988-2825-4c05-92f2-c51b615af3c8 req-37c27522-2926-439f-8e64-5fa885eae263 service nova] Enqueued Resource ID: 870d4230-10cb-4ebd-8d12-34aaae29ea98 with Priority: HIGHEST for action security_group_members [ 961.355658] env[69188]: INFO networking_nsxv3.common.synchronization [req-e617a988-2825-4c05-92f2-c51b615af3c8 req-37c27522-2926-439f-8e64-5fa885eae263 service nova] Enqueued Resource ID: 1bdd77f8-26f3-4582-a1eb-5ddb74d10e0c with Priority: HIGHEST for action port [ 961.355902] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 870d4230-10cb-4ebd-8d12-34aaae29ea98 with Priority: HIGHEST for action security_group_rules [ 961.356046] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 870d4230-10cb-4ebd-8d12-34aaae29ea98 with Priority: HIGHEST for action security_group_members [ 961.356141] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1bdd77f8-26f3-4582-a1eb-5ddb74d10e0c with Priority: HIGHEST for action port [ 961.356984] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-870d4230-10cb-4ebd-8d12-34aaae29ea98 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.357177] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-870d4230-10cb-4ebd-8d12-34aaae29ea98" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.357615] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-870d4230-10cb-4ebd-8d12-34aaae29ea98" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.357615] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-870d4230-10cb-4ebd-8d12-34aaae29ea98" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.357790] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('870d4230-10cb-4ebd-8d12-34aaae29ea98',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 961.358855] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-870d4230-10cb-4ebd-8d12-34aaae29ea98 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.359096] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-870d4230-10cb-4ebd-8d12-34aaae29ea98" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.359141] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-870d4230-10cb-4ebd-8d12-34aaae29ea98" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.359415] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-870d4230-10cb-4ebd-8d12-34aaae29ea98" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.359596] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.359785] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.359951] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.360187] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.360589] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.360589] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('870d4230-10cb-4ebd-8d12-34aaae29ea98',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 961.361912] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-1bdd77f8-26f3-4582-a1eb-5ddb74d10e0c taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.362442] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1bdd77f8-26f3-4582-a1eb-5ddb74d10e0c" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.365133] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1bdd77f8-26f3-4582-a1eb-5ddb74d10e0c" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.365353] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1bdd77f8-26f3-4582-a1eb-5ddb74d10e0c" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.365442] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1bdd77f8-26f3-4582-a1eb-5ddb74d10e0c',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 961.798538] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-fa6e8a6e-b63b-4248-b67b-4ae889fac90c taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.798881] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fa6e8a6e-b63b-4248-b67b-4ae889fac90c" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.798881] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fa6e8a6e-b63b-4248-b67b-4ae889fac90c" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.799031] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fa6e8a6e-b63b-4248-b67b-4ae889fac90c" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.799222] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.799346] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.799389] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.799552] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.799662] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.799768] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fa6e8a6e-b63b-4248-b67b-4ae889fac90c" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.799885] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fa6e8a6e-b63b-4248-b67b-4ae889fac90c',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 961.867067] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('870d4230-10cb-4ebd-8d12-34aaae29ea98',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 961.868187] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-870d4230-10cb-4ebd-8d12-34aaae29ea98 taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.868331] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-870d4230-10cb-4ebd-8d12-34aaae29ea98" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.868756] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1bdd77f8-26f3-4582-a1eb-5ddb74d10e0c with status ACTIVE [ 961.868955] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.869095] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.869204] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.869386] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.869478] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.869648] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.869760] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.869841] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.870393] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.870393] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.870393] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.870393] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.870693] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.870693] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.870693] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.870782] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1bdd77f8-26f3-4582-a1eb-5ddb74d10e0c is going to be updated. [ 961.891174] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.891314] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.891420] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.891591] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.891727] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.891888] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1bdd77f8-26f3-4582-a1eb-5ddb74d10e0c" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.304578] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-fa6e8a6e-b63b-4248-b67b-4ae889fac90c taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.304804] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fa6e8a6e-b63b-4248-b67b-4ae889fac90c" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.304891] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fa6e8a6e-b63b-4248-b67b-4ae889fac90c" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.305085] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fa6e8a6e-b63b-4248-b67b-4ae889fac90c" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.305294] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.305400] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.305467] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.305659] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.305809] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.305937] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fa6e8a6e-b63b-4248-b67b-4ae889fac90c" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.306106] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-fa6e8a6e-b63b-4248-b67b-4ae889fac90c taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.306218] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fa6e8a6e-b63b-4248-b67b-4ae889fac90c" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.306271] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fa6e8a6e-b63b-4248-b67b-4ae889fac90c" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.306434] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fa6e8a6e-b63b-4248-b67b-4ae889fac90c" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.306592] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.306695] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.306778] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.306941] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.307035] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.307119] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fa6e8a6e-b63b-4248-b67b-4ae889fac90c" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.307228] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fa6e8a6e-b63b-4248-b67b-4ae889fac90c',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 962.369429] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('870d4230-10cb-4ebd-8d12-34aaae29ea98',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 962.811016] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fa6e8a6e-b63b-4248-b67b-4ae889fac90c: rpc.has_security_group_logging(os_id): False [ 962.829195] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.829385] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.829385] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.829651] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.829746] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.830000] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.830114] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.830181] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.830340] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.830420] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.830631] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.830727] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.830789] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.830931] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.831015] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.831221] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.831333] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.831396] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.831554] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.831688] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.831783] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fa6e8a6e-b63b-4248-b67b-4ae889fac90c is going to be updated. [ 962.874896] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.875109] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.875190] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.875416] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.875689] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.875689] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 870d4230-10cb-4ebd-8d12-34aaae29ea98 is going to be created. [ 962.892028] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.892211] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.892255] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.892465] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.892639] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.900770] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.900942] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.900942] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.901180] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.901367] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.905369] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fa6e8a6e-b63b-4248-b67b-4ae889fac90c in Status: IN_PROGRESS for 2s [ 962.907962] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 870d4230-10cb-4ebd-8d12-34aaae29ea98 in Status: UNINITIALIZED for 2s [ 963.048901] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 721e26e3-d896-46ab-b5a3-92852a365813 in Status: SUCCESS [ 963.049203] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-721e26e3-d896-46ab-b5a3-92852a365813" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.049397] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-721e26e3-d896-46ab-b5a3-92852a365813" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.049628] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-721e26e3-d896-46ab-b5a3-92852a365813" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.049855] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.050069] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.050144] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.050305] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.050389] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.050475] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-721e26e3-d896-46ab-b5a3-92852a365813" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.050569] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('721e26e3-d896-46ab-b5a3-92852a365813',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 963.552912] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-721e26e3-d896-46ab-b5a3-92852a365813 taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.553153] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-721e26e3-d896-46ab-b5a3-92852a365813" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.553153] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-721e26e3-d896-46ab-b5a3-92852a365813" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.553776] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-721e26e3-d896-46ab-b5a3-92852a365813" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.553943] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.554094] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.554177] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.554340] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.554433] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.554541] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-721e26e3-d896-46ab-b5a3-92852a365813" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.554694] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-721e26e3-d896-46ab-b5a3-92852a365813 taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.554797] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-721e26e3-d896-46ab-b5a3-92852a365813" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.554863] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-721e26e3-d896-46ab-b5a3-92852a365813" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.555015] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-721e26e3-d896-46ab-b5a3-92852a365813" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.555227] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.555326] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.555401] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.555550] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.555628] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.555812] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-721e26e3-d896-46ab-b5a3-92852a365813" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.555918] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('721e26e3-d896-46ab-b5a3-92852a365813',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 964.059075] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 721e26e3-d896-46ab-b5a3-92852a365813: rpc.has_security_group_logging(os_id): False [ 964.075548] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.075723] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.075849] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.076148] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.076298] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.076609] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.076773] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.076882] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.077123] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.077238] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.077687] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.077832] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.077942] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.078145] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.078225] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.078445] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.078570] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.078644] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.078866] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.078920] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.079034] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 721e26e3-d896-46ab-b5a3-92852a365813 is going to be created. [ 964.135119] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.135385] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.135385] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.135590] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.135772] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.145337] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 721e26e3-d896-46ab-b5a3-92852a365813 in Status: IN_PROGRESS for 2s [ 964.556399] env[69188]: INFO networking_nsxv3.common.synchronization [req-11ace724-c323-4579-8716-dcc190659598 req-dd47675c-dcb8-4876-aada-861201367591 tempest-DeleteServersTestJSON-857706435 tempest-DeleteServersTestJSON-857706435-project-member] Enqueued Resource ID: 397559b2-3c5a-424d-b09d-43a25d2abba6 with Priority: HIGHEST for action security_group_members [ 964.556986] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 397559b2-3c5a-424d-b09d-43a25d2abba6 with Priority: HIGHEST for action security_group_members [ 964.557301] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-397559b2-3c5a-424d-b09d-43a25d2abba6 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.558565] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-397559b2-3c5a-424d-b09d-43a25d2abba6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.558565] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-397559b2-3c5a-424d-b09d-43a25d2abba6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.558565] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-397559b2-3c5a-424d-b09d-43a25d2abba6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.558774] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.558881] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.558922] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.559092] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.559184] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.559279] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('397559b2-3c5a-424d-b09d-43a25d2abba6',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 964.916455] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 870d4230-10cb-4ebd-8d12-34aaae29ea98 in Status: SUCCESS [ 964.916805] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-870d4230-10cb-4ebd-8d12-34aaae29ea98" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.916931] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-870d4230-10cb-4ebd-8d12-34aaae29ea98" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.917113] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-870d4230-10cb-4ebd-8d12-34aaae29ea98" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.917308] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.917451] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.917540] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.917650] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.917791] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.917894] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-870d4230-10cb-4ebd-8d12-34aaae29ea98" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.917989] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('870d4230-10cb-4ebd-8d12-34aaae29ea98',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 964.919499] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fa6e8a6e-b63b-4248-b67b-4ae889fac90c in Status: SUCCESS [ 964.919682] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fa6e8a6e-b63b-4248-b67b-4ae889fac90c" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.939029] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock network-449 taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.939029] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "network-449" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.939029] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "network-449" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.939029] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "network-449" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.939029] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.939029] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.939029] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.939029] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.939029] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.939029] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 964.939029] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] NeedRegenerationException {{(pid=69188) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 964.939615] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] no value, waiting for create lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 964.939615] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] value creation lock acquired {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 964.939615] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 964.939615] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Calling creation function for not-yet-present value {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 964.939615] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 964.957858] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 964.957858] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69188) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 964.958198] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Released creation lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 964.958198] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "network-449" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.958649] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock port-d9501102-e1b8-493f-939d-8cd845b3abf8 taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.958649] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "port-d9501102-e1b8-493f-939d-8cd845b3abf8" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.959032] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "port-d9501102-e1b8-493f-939d-8cd845b3abf8" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.959397] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "port-d9501102-e1b8-493f-939d-8cd845b3abf8" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.959397] env[69188]: DEBUG networking_nsxv3.api.rpc [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d9501102-e1b8-493f-939d-8cd845b3abf8',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 965.062175] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.062500] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.062500] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.062767] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.081813] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.082103] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.082231] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.082301] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.082499] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.082584] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.082800] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 397559b2-3c5a-424d-b09d-43a25d2abba6 is going to be updated. [ 965.109387] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.109561] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.109609] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.109802] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.110234] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.119235] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 397559b2-3c5a-424d-b09d-43a25d2abba6 in Status: IN_PROGRESS for 2s [ 965.421150] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-870d4230-10cb-4ebd-8d12-34aaae29ea98 taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.421341] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-870d4230-10cb-4ebd-8d12-34aaae29ea98" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.421435] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-870d4230-10cb-4ebd-8d12-34aaae29ea98" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.421668] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-870d4230-10cb-4ebd-8d12-34aaae29ea98" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.421858] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.422033] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.423950] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.423950] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.423950] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.423950] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-870d4230-10cb-4ebd-8d12-34aaae29ea98" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.423950] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-870d4230-10cb-4ebd-8d12-34aaae29ea98 taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.423950] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-870d4230-10cb-4ebd-8d12-34aaae29ea98" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.423950] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-870d4230-10cb-4ebd-8d12-34aaae29ea98" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.423950] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-870d4230-10cb-4ebd-8d12-34aaae29ea98" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.423950] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.423950] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.423950] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.423950] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.423950] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.423950] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-870d4230-10cb-4ebd-8d12-34aaae29ea98" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.423950] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('870d4230-10cb-4ebd-8d12-34aaae29ea98',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 965.462839] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.463330] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.463542] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.464018] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.464298] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.464559] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Segment Port d9501102-e1b8-493f-939d-8cd845b3abf8 not found, creating... [ 965.465073] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.465377] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.465565] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.466062] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.466062] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.466987] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.466987] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.466987] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.467223] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.467381] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.467497] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Resource: SegmentPort with ID: d9501102-e1b8-493f-939d-8cd845b3abf8 is going to be created. [ 965.487526] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.487962] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.488178] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.488724] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.489181] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.489390] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "port-d9501102-e1b8-493f-939d-8cd845b3abf8" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.926716] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 870d4230-10cb-4ebd-8d12-34aaae29ea98: rpc.has_security_group_logging(os_id): False [ 965.945883] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.945883] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.945883] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.945883] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.945883] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.945883] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.945883] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.945883] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.945883] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.945883] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.945883] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.945883] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.945883] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.945883] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.945883] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.946401] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.946401] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.946511] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.946657] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.946769] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.946769] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 870d4230-10cb-4ebd-8d12-34aaae29ea98 is going to be created. [ 966.001497] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.002171] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.002171] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.002171] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.002324] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.014513] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 870d4230-10cb-4ebd-8d12-34aaae29ea98 in Status: IN_PROGRESS for 2s [ 966.158365] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 721e26e3-d896-46ab-b5a3-92852a365813 in Status: SUCCESS [ 966.158669] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-721e26e3-d896-46ab-b5a3-92852a365813" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.379020] env[69188]: INFO networking_nsxv3.common.synchronization [req-11ace724-c323-4579-8716-dcc190659598 req-944fdd11-6060-4064-a483-6e78f67893a4 service nova] Enqueued Resource ID: 397559b2-3c5a-424d-b09d-43a25d2abba6 with Priority: HIGHEST for action security_group_rules [ 966.379020] env[69188]: INFO networking_nsxv3.common.synchronization [req-11ace724-c323-4579-8716-dcc190659598 req-944fdd11-6060-4064-a483-6e78f67893a4 service nova] Enqueued Resource ID: 397559b2-3c5a-424d-b09d-43a25d2abba6 with Priority: HIGHEST for action security_group_members [ 966.379020] env[69188]: INFO networking_nsxv3.common.synchronization [req-11ace724-c323-4579-8716-dcc190659598 req-944fdd11-6060-4064-a483-6e78f67893a4 service nova] Enqueued Resource ID: d9501102-e1b8-493f-939d-8cd845b3abf8 with Priority: HIGHEST for action port [ 966.379020] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 397559b2-3c5a-424d-b09d-43a25d2abba6 with Priority: HIGHEST for action security_group_rules [ 966.379020] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 397559b2-3c5a-424d-b09d-43a25d2abba6 with Priority: HIGHEST for action security_group_members [ 966.379020] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d9501102-e1b8-493f-939d-8cd845b3abf8 with Priority: HIGHEST for action port [ 966.379020] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-397559b2-3c5a-424d-b09d-43a25d2abba6 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.379778] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-397559b2-3c5a-424d-b09d-43a25d2abba6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.380039] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-397559b2-3c5a-424d-b09d-43a25d2abba6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.380463] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-397559b2-3c5a-424d-b09d-43a25d2abba6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.380704] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('397559b2-3c5a-424d-b09d-43a25d2abba6',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 966.383791] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-397559b2-3c5a-424d-b09d-43a25d2abba6 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.383791] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-397559b2-3c5a-424d-b09d-43a25d2abba6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.383791] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-d9501102-e1b8-493f-939d-8cd845b3abf8 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.383791] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d9501102-e1b8-493f-939d-8cd845b3abf8" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.383791] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d9501102-e1b8-493f-939d-8cd845b3abf8" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.383791] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d9501102-e1b8-493f-939d-8cd845b3abf8" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.383791] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d9501102-e1b8-493f-939d-8cd845b3abf8',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 966.885024] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-397559b2-3c5a-424d-b09d-43a25d2abba6 taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.885024] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-397559b2-3c5a-424d-b09d-43a25d2abba6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.885184] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d9501102-e1b8-493f-939d-8cd845b3abf8 with status ACTIVE [ 966.885260] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.885359] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.885423] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.885627] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.885710] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.885872] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.885961] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.886034] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.886177] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.886252] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.886423] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.886508] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.886579] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.886713] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.886783] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.886887] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d9501102-e1b8-493f-939d-8cd845b3abf8 is going to be updated. [ 966.906859] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.906859] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.906859] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.906859] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.906859] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.907153] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d9501102-e1b8-493f-939d-8cd845b3abf8" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.135046] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 397559b2-3c5a-424d-b09d-43a25d2abba6 in Status: SUCCESS [ 967.135046] env[69188]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 397559b2-3c5a-424d-b09d-43a25d2abba6 deletion is rescheduled due to dependency. [ 967.135046] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-397559b2-3c5a-424d-b09d-43a25d2abba6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.135046] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-397559b2-3c5a-424d-b09d-43a25d2abba6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.135046] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-397559b2-3c5a-424d-b09d-43a25d2abba6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.135046] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.135046] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.135046] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.135046] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.135046] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.135046] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('397559b2-3c5a-424d-b09d-43a25d2abba6',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 967.637451] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('397559b2-3c5a-424d-b09d-43a25d2abba6',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 968.029917] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 870d4230-10cb-4ebd-8d12-34aaae29ea98 in Status: SUCCESS [ 968.029917] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-870d4230-10cb-4ebd-8d12-34aaae29ea98" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.141043] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('397559b2-3c5a-424d-b09d-43a25d2abba6',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 968.647045] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.647045] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.647045] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.647045] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.647045] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.647045] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 397559b2-3c5a-424d-b09d-43a25d2abba6 is going to be updated. [ 968.675571] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.675571] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.675706] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.675916] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.676073] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.683710] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 397559b2-3c5a-424d-b09d-43a25d2abba6 in Status: IN_PROGRESS for 2s [ 969.399684] env[69188]: INFO networking_nsxv3.common.synchronization [req-48d561ab-63e0-4dba-9e82-692c1b1a357c req-fcbaf404-d5ee-473b-aaad-824c2831bd5d tempest-MigrationsAdminTest-718349773 tempest-MigrationsAdminTest-718349773-project-member] Enqueued Resource ID: 345a1564-5c47-4d81-9096-66a6ad96570a with Priority: HIGHEST for action security_group_members [ 969.400257] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 345a1564-5c47-4d81-9096-66a6ad96570a with Priority: HIGHEST for action security_group_members [ 969.400556] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-345a1564-5c47-4d81-9096-66a6ad96570a taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.400673] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-345a1564-5c47-4d81-9096-66a6ad96570a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.400739] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-345a1564-5c47-4d81-9096-66a6ad96570a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.400934] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-345a1564-5c47-4d81-9096-66a6ad96570a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.404541] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.404541] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.404541] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.404774] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.404939] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.405076] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('345a1564-5c47-4d81-9096-66a6ad96570a',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 969.907860] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.908133] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.908133] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.908835] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.927346] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.927668] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.927814] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.927879] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.928095] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.928184] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.928282] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 345a1564-5c47-4d81-9096-66a6ad96570a is going to be updated. [ 969.954668] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.954841] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.954901] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.955224] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.955224] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.963897] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 345a1564-5c47-4d81-9096-66a6ad96570a in Status: IN_PROGRESS for 2s [ 970.693947] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 397559b2-3c5a-424d-b09d-43a25d2abba6 in Status: SUCCESS [ 970.694353] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-397559b2-3c5a-424d-b09d-43a25d2abba6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.695017] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-397559b2-3c5a-424d-b09d-43a25d2abba6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.695393] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-397559b2-3c5a-424d-b09d-43a25d2abba6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.695645] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.695920] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.695920] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.696188] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.696322] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.696451] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-397559b2-3c5a-424d-b09d-43a25d2abba6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.696828] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('397559b2-3c5a-424d-b09d-43a25d2abba6',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.201087] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-397559b2-3c5a-424d-b09d-43a25d2abba6 taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.202037] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-397559b2-3c5a-424d-b09d-43a25d2abba6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.202037] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-397559b2-3c5a-424d-b09d-43a25d2abba6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.202317] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-397559b2-3c5a-424d-b09d-43a25d2abba6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.202539] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.202668] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.202738] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.202980] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.203095] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.203218] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-397559b2-3c5a-424d-b09d-43a25d2abba6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.203453] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-397559b2-3c5a-424d-b09d-43a25d2abba6 taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.203517] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-397559b2-3c5a-424d-b09d-43a25d2abba6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.203571] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-397559b2-3c5a-424d-b09d-43a25d2abba6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.203764] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-397559b2-3c5a-424d-b09d-43a25d2abba6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.203954] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.204103] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.204187] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.204356] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.204458] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.204566] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-397559b2-3c5a-424d-b09d-43a25d2abba6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.204676] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('397559b2-3c5a-424d-b09d-43a25d2abba6',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.713625] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 397559b2-3c5a-424d-b09d-43a25d2abba6: rpc.has_security_group_logging(os_id): False [ 971.732896] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.733207] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.733328] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.733562] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.733660] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.733903] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.734017] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.734082] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.734242] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.735367] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.735367] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.735367] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.735367] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.735367] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.735367] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.735764] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.735764] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.735877] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.736454] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.736971] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.737294] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 397559b2-3c5a-424d-b09d-43a25d2abba6 is going to be updated. [ 971.810330] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.810330] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.810330] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.810330] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.810330] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.829125] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 397559b2-3c5a-424d-b09d-43a25d2abba6 in Status: IN_PROGRESS for 2s [ 971.973966] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 345a1564-5c47-4d81-9096-66a6ad96570a in Status: SUCCESS [ 971.974173] env[69188]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 345a1564-5c47-4d81-9096-66a6ad96570a deletion is rescheduled due to dependency. [ 971.974291] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-345a1564-5c47-4d81-9096-66a6ad96570a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.183835] env[69188]: INFO networking_nsxv3.common.synchronization [None req-bff57649-c717-4536-aae5-c1feeb287481 None None] Enqueued Resource ID: 969ae9e8-5192-4b9b-8d60-d0445acd65a4 with Priority: HIGHEST for action port [ 972.188167] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 969ae9e8-5192-4b9b-8d60-d0445acd65a4 with Priority: HIGHEST for action port [ 972.188167] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-969ae9e8-5192-4b9b-8d60-d0445acd65a4 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.188167] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-969ae9e8-5192-4b9b-8d60-d0445acd65a4" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.188167] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-969ae9e8-5192-4b9b-8d60-d0445acd65a4" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.188167] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-969ae9e8-5192-4b9b-8d60-d0445acd65a4" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.188828] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('969ae9e8-5192-4b9b-8d60-d0445acd65a4',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 972.691959] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 969ae9e8-5192-4b9b-8d60-d0445acd65a4 [ 972.692315] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.692417] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.692417] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.692628] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.692719] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.692818] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:969ae9e8-5192-4b9b-8d60-d0445acd65a4 already deleted. [ 972.692898] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-969ae9e8-5192-4b9b-8d60-d0445acd65a4" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.280815] env[69188]: INFO networking_nsxv3.common.synchronization [None req-f0eda8e8-6077-432d-82cb-4c8eb2fa4987 tempest-AttachInterfacesTestJSON-1255877948 tempest-AttachInterfacesTestJSON-1255877948-project-member] Enqueued Resource ID: 048d5e2e-adfe-4bc0-9ae5-f6d99d633e62 with Priority: HIGHEST for action security_group_rules [ 973.281438] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 048d5e2e-adfe-4bc0-9ae5-f6d99d633e62 with Priority: HIGHEST for action security_group_rules [ 973.281438] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-048d5e2e-adfe-4bc0-9ae5-f6d99d633e62 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.281704] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-048d5e2e-adfe-4bc0-9ae5-f6d99d633e62" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.281704] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-048d5e2e-adfe-4bc0-9ae5-f6d99d633e62" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.282072] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-048d5e2e-adfe-4bc0-9ae5-f6d99d633e62" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.285000] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('048d5e2e-adfe-4bc0-9ae5-f6d99d633e62',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 973.396020] env[69188]: INFO networking_nsxv3.common.synchronization [None req-25d6d23d-e064-4900-a531-11aece425f2a tempest-AttachInterfacesTestJSON-1255877948 tempest-AttachInterfacesTestJSON-1255877948-project-member] Enqueued Resource ID: 048d5e2e-adfe-4bc0-9ae5-f6d99d633e62 with Priority: HIGHEST for action security_group_rules [ 973.396664] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 048d5e2e-adfe-4bc0-9ae5-f6d99d633e62 with Priority: HIGHEST for action security_group_rules [ 973.398267] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-048d5e2e-adfe-4bc0-9ae5-f6d99d633e62 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.398267] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-048d5e2e-adfe-4bc0-9ae5-f6d99d633e62" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.400704] env[69188]: INFO networking_nsxv3.common.synchronization [req-c7f9fb0f-dcb4-4d22-88b7-a091f127b87b req-bbe0b3f2-65db-4a71-b023-45e5da0afe4e tempest-SecurityGroupsTestJSON-1621209229 tempest-SecurityGroupsTestJSON-1621209229-project-member] Enqueued Resource ID: b99e414b-ff9c-4d19-b3c8-32ab58288d75 with Priority: HIGHEST for action security_group_members [ 973.401040] env[69188]: INFO networking_nsxv3.common.synchronization [req-c7f9fb0f-dcb4-4d22-88b7-a091f127b87b req-bbe0b3f2-65db-4a71-b023-45e5da0afe4e tempest-SecurityGroupsTestJSON-1621209229 tempest-SecurityGroupsTestJSON-1621209229-project-member] Enqueued Resource ID: e275bda6-f504-45ea-9805-84ac49a67aa7 with Priority: HIGHEST for action security_group_members [ 973.401040] env[69188]: INFO networking_nsxv3.common.synchronization [req-c7f9fb0f-dcb4-4d22-88b7-a091f127b87b req-bbe0b3f2-65db-4a71-b023-45e5da0afe4e tempest-SecurityGroupsTestJSON-1621209229 tempest-SecurityGroupsTestJSON-1621209229-project-member] Enqueued Resource ID: 166e7c17-8917-425e-9cd8-0580f8aa3e74 with Priority: HIGHEST for action security_group_members [ 973.401336] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b99e414b-ff9c-4d19-b3c8-32ab58288d75 with Priority: HIGHEST for action security_group_members [ 973.401478] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e275bda6-f504-45ea-9805-84ac49a67aa7 with Priority: HIGHEST for action security_group_members [ 973.401576] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 166e7c17-8917-425e-9cd8-0580f8aa3e74 with Priority: HIGHEST for action security_group_members [ 973.402471] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-b99e414b-ff9c-4d19-b3c8-32ab58288d75 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.402471] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b99e414b-ff9c-4d19-b3c8-32ab58288d75" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.402471] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b99e414b-ff9c-4d19-b3c8-32ab58288d75" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.402637] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b99e414b-ff9c-4d19-b3c8-32ab58288d75" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.402668] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.403545] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.403545] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.403545] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.404315] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.405575] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b99e414b-ff9c-4d19-b3c8-32ab58288d75',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 973.407868] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-e275bda6-f504-45ea-9805-84ac49a67aa7 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.407868] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e275bda6-f504-45ea-9805-84ac49a67aa7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.407868] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e275bda6-f504-45ea-9805-84ac49a67aa7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.407868] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e275bda6-f504-45ea-9805-84ac49a67aa7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.407868] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.407868] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.407868] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.407868] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.407868] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.407868] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e275bda6-f504-45ea-9805-84ac49a67aa7',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 973.408745] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-166e7c17-8917-425e-9cd8-0580f8aa3e74 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.408745] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-166e7c17-8917-425e-9cd8-0580f8aa3e74" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.408745] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-166e7c17-8917-425e-9cd8-0580f8aa3e74" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.408958] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-166e7c17-8917-425e-9cd8-0580f8aa3e74" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.409324] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.409324] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.409324] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.411805] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.411805] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.411805] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('166e7c17-8917-425e-9cd8-0580f8aa3e74',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 973.804692] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.805026] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.805026] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.805183] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.806338] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.806338] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 048d5e2e-adfe-4bc0-9ae5-f6d99d633e62 already deleted. [ 973.806470] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-048d5e2e-adfe-4bc0-9ae5-f6d99d633e62" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.806635] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-048d5e2e-adfe-4bc0-9ae5-f6d99d633e62" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.806929] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-048d5e2e-adfe-4bc0-9ae5-f6d99d633e62" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.807043] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('048d5e2e-adfe-4bc0-9ae5-f6d99d633e62',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 973.844682] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 397559b2-3c5a-424d-b09d-43a25d2abba6 in Status: SUCCESS [ 973.844682] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-397559b2-3c5a-424d-b09d-43a25d2abba6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.911834] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.911982] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.912067] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.912581] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.913760] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.914217] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.914576] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.914669] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.932508] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.932816] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.933347] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.933347] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.933347] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.933347] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.933347] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e275bda6-f504-45ea-9805-84ac49a67aa7 is going to be updated. [ 973.937016] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.937016] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.937016] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.937016] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.937016] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.937016] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.937016] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.937016] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.937016] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b99e414b-ff9c-4d19-b3c8-32ab58288d75 is going to be updated. [ 973.937016] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.937016] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.957027] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.958030] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.959218] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.959297] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.959678] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.959772] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.959872] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 166e7c17-8917-425e-9cd8-0580f8aa3e74 is going to be updated. [ 973.962704] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.962821] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.962887] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.963212] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.963348] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.964906] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.965031] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.965103] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.965268] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.965383] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.972418] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e275bda6-f504-45ea-9805-84ac49a67aa7 in Status: IN_PROGRESS for 2s [ 973.972418] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b99e414b-ff9c-4d19-b3c8-32ab58288d75 in Status: IN_PROGRESS for 2s [ 973.985507] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.985707] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.985707] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.986034] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.987491] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.994633] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 166e7c17-8917-425e-9cd8-0580f8aa3e74 in Status: IN_PROGRESS for 2s [ 974.333599] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.333599] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.333599] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.335433] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.335433] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.335433] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 048d5e2e-adfe-4bc0-9ae5-f6d99d633e62 already deleted. [ 974.335433] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-048d5e2e-adfe-4bc0-9ae5-f6d99d633e62" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.559191] env[69188]: INFO networking_nsxv3.common.synchronization [None req-26e4fb10-12fc-4723-a088-4d5974332ad7 None None] Enqueued Resource ID: f8efc9ef-e106-4bd4-a407-a91a105fd498 with Priority: HIGHEST for action port [ 974.559655] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f8efc9ef-e106-4bd4-a407-a91a105fd498 with Priority: HIGHEST for action port [ 974.560601] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-f8efc9ef-e106-4bd4-a407-a91a105fd498 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.560869] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f8efc9ef-e106-4bd4-a407-a91a105fd498" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.561075] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f8efc9ef-e106-4bd4-a407-a91a105fd498" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.561510] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f8efc9ef-e106-4bd4-a407-a91a105fd498" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.561707] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f8efc9ef-e106-4bd4-a407-a91a105fd498',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 975.063879] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f8efc9ef-e106-4bd4-a407-a91a105fd498 [ 975.064419] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.064685] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.064842] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.065808] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.065953] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.066024] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f8efc9ef-e106-4bd4-a407-a91a105fd498 already deleted. [ 975.066119] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f8efc9ef-e106-4bd4-a407-a91a105fd498" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.984958] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e275bda6-f504-45ea-9805-84ac49a67aa7 in Status: SUCCESS [ 975.984958] env[69188]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e275bda6-f504-45ea-9805-84ac49a67aa7 deletion is rescheduled due to dependency. [ 975.984958] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e275bda6-f504-45ea-9805-84ac49a67aa7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.984958] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b99e414b-ff9c-4d19-b3c8-32ab58288d75 in Status: SUCCESS [ 975.984958] env[69188]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b99e414b-ff9c-4d19-b3c8-32ab58288d75 deletion is rescheduled due to dependency. [ 975.984958] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b99e414b-ff9c-4d19-b3c8-32ab58288d75" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.005637] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 166e7c17-8917-425e-9cd8-0580f8aa3e74 in Status: SUCCESS [ 976.005637] env[69188]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 166e7c17-8917-425e-9cd8-0580f8aa3e74 deletion is rescheduled due to dependency. [ 976.005637] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-166e7c17-8917-425e-9cd8-0580f8aa3e74" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.234039] env[69188]: INFO networking_nsxv3.common.synchronization [req-f26f3805-9a1c-4355-a10e-d5915e580741 req-02a9b6fc-db12-4028-9a0d-f2e08a3a0758 tempest-ServerDiagnosticsTest-1385495615 tempest-ServerDiagnosticsTest-1385495615-project-member] Enqueued Resource ID: 870d4230-10cb-4ebd-8d12-34aaae29ea98 with Priority: HIGHEST for action security_group_members [ 977.235069] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 870d4230-10cb-4ebd-8d12-34aaae29ea98 with Priority: HIGHEST for action security_group_members [ 977.235069] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-870d4230-10cb-4ebd-8d12-34aaae29ea98 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.235069] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-870d4230-10cb-4ebd-8d12-34aaae29ea98" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.235264] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-870d4230-10cb-4ebd-8d12-34aaae29ea98" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.235353] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-870d4230-10cb-4ebd-8d12-34aaae29ea98" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.235504] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.235604] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.235667] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.235815] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.235913] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.236012] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('870d4230-10cb-4ebd-8d12-34aaae29ea98',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 977.332526] env[69188]: INFO networking_nsxv3.common.synchronization [None req-7e6c371d-bc81-4c37-8d61-674a7cb448bd None None] Enqueued Resource ID: f6d42188-e572-4bd7-bf83-2a88a9f3693d with Priority: HIGHEST for action port [ 977.333201] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f6d42188-e572-4bd7-bf83-2a88a9f3693d with Priority: HIGHEST for action port [ 977.333511] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-f6d42188-e572-4bd7-bf83-2a88a9f3693d taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.333637] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f6d42188-e572-4bd7-bf83-2a88a9f3693d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.333702] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f6d42188-e572-4bd7-bf83-2a88a9f3693d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.333954] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f6d42188-e572-4bd7-bf83-2a88a9f3693d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.334189] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f6d42188-e572-4bd7-bf83-2a88a9f3693d',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 977.592035] env[69188]: INFO networking_nsxv3.common.synchronization [req-a7434196-7a46-4f3c-875d-e8545630a301 req-4ba55378-f3d3-4585-b09d-141b704ec68d tempest-VolumesAdminNegativeTest-627287247 tempest-VolumesAdminNegativeTest-627287247-project-member] Enqueued Resource ID: cd207b0a-02a6-4378-9240-c9d49160b653 with Priority: HIGHEST for action security_group_members [ 977.592035] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cd207b0a-02a6-4378-9240-c9d49160b653 with Priority: HIGHEST for action security_group_members [ 977.592035] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-cd207b0a-02a6-4378-9240-c9d49160b653 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.592035] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cd207b0a-02a6-4378-9240-c9d49160b653" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.592035] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cd207b0a-02a6-4378-9240-c9d49160b653" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.592035] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cd207b0a-02a6-4378-9240-c9d49160b653" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.592035] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.594073] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.595030] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.595030] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.595030] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.595030] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cd207b0a-02a6-4378-9240-c9d49160b653',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 977.740723] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.741074] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.741074] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.741366] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.741449] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.741692] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.741823] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.741889] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.742022] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.742186] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.742251] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 870d4230-10cb-4ebd-8d12-34aaae29ea98 is going to be updated. [ 977.784938] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.785107] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.785199] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.785459] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.785623] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.794637] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 870d4230-10cb-4ebd-8d12-34aaae29ea98 in Status: IN_PROGRESS for 2s [ 977.838381] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f6d42188-e572-4bd7-bf83-2a88a9f3693d [ 977.838381] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.838381] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.838381] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.838381] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.838381] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.838381] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f6d42188-e572-4bd7-bf83-2a88a9f3693d already deleted. [ 977.838381] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f6d42188-e572-4bd7-bf83-2a88a9f3693d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.104650] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.104851] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.104981] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.105817] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.138952] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.139543] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.139543] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.139543] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.139819] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.139819] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.139943] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cd207b0a-02a6-4378-9240-c9d49160b653 is going to be updated. [ 978.178826] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.178826] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.178826] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.178826] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.178826] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.187514] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cd207b0a-02a6-4378-9240-c9d49160b653 in Status: IN_PROGRESS for 2s [ 978.856960] env[69188]: INFO networking_nsxv3.common.synchronization [None req-03d44504-dc65-4a43-a5a8-3ee64d279147 tempest-ServersTestBootFromVolume-721515798 tempest-ServersTestBootFromVolume-721515798-project-member] Enqueued Resource ID: 5f183b9d-5066-4eee-a079-2adf3a1d0f7c with Priority: HIGHEST for action security_group_rules [ 978.857387] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5f183b9d-5066-4eee-a079-2adf3a1d0f7c with Priority: HIGHEST for action security_group_rules [ 978.857716] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5f183b9d-5066-4eee-a079-2adf3a1d0f7c taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.857851] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5f183b9d-5066-4eee-a079-2adf3a1d0f7c" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.857919] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5f183b9d-5066-4eee-a079-2adf3a1d0f7c" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.858201] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5f183b9d-5066-4eee-a079-2adf3a1d0f7c" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.858283] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5f183b9d-5066-4eee-a079-2adf3a1d0f7c',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 979.067130] env[69188]: INFO networking_nsxv3.common.synchronization [None req-dc686281-c75b-46a4-9103-c5ab28abad9a tempest-ServersTestBootFromVolume-721515798 tempest-ServersTestBootFromVolume-721515798-project-member] Enqueued Resource ID: 5f183b9d-5066-4eee-a079-2adf3a1d0f7c with Priority: HIGHEST for action security_group_rules [ 979.067130] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5f183b9d-5066-4eee-a079-2adf3a1d0f7c with Priority: HIGHEST for action security_group_rules [ 979.067130] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5f183b9d-5066-4eee-a079-2adf3a1d0f7c taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.067130] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5f183b9d-5066-4eee-a079-2adf3a1d0f7c" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.381105] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.381403] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.381593] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.381891] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.382112] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.383541] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5f183b9d-5066-4eee-a079-2adf3a1d0f7c already deleted. [ 979.383828] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5f183b9d-5066-4eee-a079-2adf3a1d0f7c" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.383923] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5f183b9d-5066-4eee-a079-2adf3a1d0f7c" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.384161] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5f183b9d-5066-4eee-a079-2adf3a1d0f7c" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.384296] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5f183b9d-5066-4eee-a079-2adf3a1d0f7c',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 979.432603] env[69188]: INFO networking_nsxv3.common.synchronization [None req-dc06a97b-de3a-4e48-a0d5-e38857282599 None None] Enqueued Resource ID: d0698f05-e861-4b1a-a24d-b9f1126acb5f with Priority: HIGHEST for action port [ 979.435950] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d0698f05-e861-4b1a-a24d-b9f1126acb5f with Priority: HIGHEST for action port [ 979.438550] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-d0698f05-e861-4b1a-a24d-b9f1126acb5f taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.439118] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d0698f05-e861-4b1a-a24d-b9f1126acb5f" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.439274] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d0698f05-e861-4b1a-a24d-b9f1126acb5f" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.439869] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d0698f05-e861-4b1a-a24d-b9f1126acb5f" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.440063] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d0698f05-e861-4b1a-a24d-b9f1126acb5f',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 979.764234] env[69188]: INFO networking_nsxv3.common.synchronization [req-5893dc44-c15b-4114-acb7-edb75c3fb247 req-e47fd684-29db-4eee-a960-f3904596c6f5 tempest-ServersNegativeTestMultiTenantJSON-1069831443 tempest-ServersNegativeTestMultiTenantJSON-1069831443-project-member] Enqueued Resource ID: abb7f382-0834-4984-98c9-82d36651f452 with Priority: HIGHEST for action security_group_members [ 979.764234] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: abb7f382-0834-4984-98c9-82d36651f452 with Priority: HIGHEST for action security_group_members [ 979.765625] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-abb7f382-0834-4984-98c9-82d36651f452 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.765832] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-abb7f382-0834-4984-98c9-82d36651f452" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.765832] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-abb7f382-0834-4984-98c9-82d36651f452" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.766122] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-abb7f382-0834-4984-98c9-82d36651f452" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.766289] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.766423] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.766512] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.766638] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.766721] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.766845] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('abb7f382-0834-4984-98c9-82d36651f452',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 979.805451] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 870d4230-10cb-4ebd-8d12-34aaae29ea98 in Status: SUCCESS [ 979.805770] env[69188]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 870d4230-10cb-4ebd-8d12-34aaae29ea98 deletion is rescheduled due to dependency. [ 979.805835] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-870d4230-10cb-4ebd-8d12-34aaae29ea98" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.913175] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.913624] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.913624] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.913839] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.913943] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.914106] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5f183b9d-5066-4eee-a079-2adf3a1d0f7c already deleted. [ 979.914277] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5f183b9d-5066-4eee-a079-2adf3a1d0f7c" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.945030] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d0698f05-e861-4b1a-a24d-b9f1126acb5f [ 979.945030] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.945030] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.945030] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.946828] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.946828] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.946828] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d0698f05-e861-4b1a-a24d-b9f1126acb5f already deleted. [ 979.946828] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d0698f05-e861-4b1a-a24d-b9f1126acb5f" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.269906] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.270011] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.270165] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.270402] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.270854] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.270854] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.270854] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.270854] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.271048] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.271085] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.271141] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: abb7f382-0834-4984-98c9-82d36651f452 already deleted. [ 980.271258] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-abb7f382-0834-4984-98c9-82d36651f452" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.288810] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cd207b0a-02a6-4378-9240-c9d49160b653 in Status: SUCCESS [ 980.289077] env[69188]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cd207b0a-02a6-4378-9240-c9d49160b653 deletion is rescheduled due to dependency. [ 980.289203] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cd207b0a-02a6-4378-9240-c9d49160b653" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.352374] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock network-846 taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.352641] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "network-846" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.352773] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "network-846" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.353142] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "network-846" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.353434] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.353613] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.353741] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.355105] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.355105] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.355105] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 980.355105] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] NeedRegenerationException {{(pid=69188) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 980.355105] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] no value, waiting for create lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 980.355105] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] value creation lock acquired {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 980.355105] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 980.355105] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Calling creation function for not-yet-present value {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 980.355105] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 980.377173] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 980.377339] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69188) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 980.377480] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Released creation lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 980.377697] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "network-846" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.377962] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock port-cca83c4c-51e2-4809-a82a-3b24bd3c8bef taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.378153] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "port-cca83c4c-51e2-4809-a82a-3b24bd3c8bef" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.378280] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "port-cca83c4c-51e2-4809-a82a-3b24bd3c8bef" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.378646] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "port-cca83c4c-51e2-4809-a82a-3b24bd3c8bef" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.378794] env[69188]: DEBUG networking_nsxv3.api.rpc [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cca83c4c-51e2-4809-a82a-3b24bd3c8bef',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 980.684113] env[69188]: INFO networking_nsxv3.common.synchronization [req-76e04234-b72e-485d-8f51-b089479a6416 req-b7dd6a45-cc9f-4a6b-8415-839cee380b57 tempest-DeleteServersTestJSON-857706435 tempest-DeleteServersTestJSON-857706435-project-member] Enqueued Resource ID: 397559b2-3c5a-424d-b09d-43a25d2abba6 with Priority: HIGHEST for action security_group_members [ 980.684670] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 397559b2-3c5a-424d-b09d-43a25d2abba6 with Priority: HIGHEST for action security_group_members [ 980.685007] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-397559b2-3c5a-424d-b09d-43a25d2abba6 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.685141] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-397559b2-3c5a-424d-b09d-43a25d2abba6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.686735] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-397559b2-3c5a-424d-b09d-43a25d2abba6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.687016] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-397559b2-3c5a-424d-b09d-43a25d2abba6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.687190] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.687301] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.687364] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.687516] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.687607] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.687692] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('397559b2-3c5a-424d-b09d-43a25d2abba6',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 980.775246] env[69188]: INFO networking_nsxv3.common.synchronization [req-c0634471-0c1b-405c-b2fb-de0239e689c4 req-1561ec5d-4551-4adf-bdee-24ee6942f8ae tempest-InstanceActionsTestJSON-2066681535 tempest-InstanceActionsTestJSON-2066681535-project-member] Enqueued Resource ID: 721e26e3-d896-46ab-b5a3-92852a365813 with Priority: HIGHEST for action security_group_members [ 980.775731] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 721e26e3-d896-46ab-b5a3-92852a365813 with Priority: HIGHEST for action security_group_members [ 980.776039] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-721e26e3-d896-46ab-b5a3-92852a365813 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.776169] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-721e26e3-d896-46ab-b5a3-92852a365813" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.776237] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-721e26e3-d896-46ab-b5a3-92852a365813" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.776439] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-721e26e3-d896-46ab-b5a3-92852a365813" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.776589] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.776687] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.776749] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.776908] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.777015] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.777257] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('721e26e3-d896-46ab-b5a3-92852a365813',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 980.881782] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.882046] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.882188] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.882477] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.882633] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.882795] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Segment Port cca83c4c-51e2-4809-a82a-3b24bd3c8bef not found, creating... [ 980.883079] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.883244] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.883368] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.883607] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.883752] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.884049] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.884216] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.884342] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.884570] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.884742] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.884937] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Resource: SegmentPort with ID: cca83c4c-51e2-4809-a82a-3b24bd3c8bef is going to be created. [ 980.907265] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.907491] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.907555] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.907823] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.908022] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.908282] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "port-cca83c4c-51e2-4809-a82a-3b24bd3c8bef" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.190040] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.190428] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.190428] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.190500] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.190704] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.190988] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.191188] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.191323] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.191558] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.191695] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.191840] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 397559b2-3c5a-424d-b09d-43a25d2abba6 is going to be updated. [ 981.216391] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.216571] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.216611] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.216810] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.216974] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.224751] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 397559b2-3c5a-424d-b09d-43a25d2abba6 in Status: IN_PROGRESS for 2s [ 981.279455] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.279612] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.279719] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.279885] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.279980] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.280198] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.280290] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.280418] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.280503] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.280573] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.280662] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 721e26e3-d896-46ab-b5a3-92852a365813 is going to be updated. [ 981.307998] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.308194] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.308271] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.308468] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.308527] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.316419] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 721e26e3-d896-46ab-b5a3-92852a365813 in Status: IN_PROGRESS for 2s [ 981.586990] env[69188]: INFO networking_nsxv3.common.synchronization [req-5893dc44-c15b-4114-acb7-edb75c3fb247 req-4cc5a94f-4143-4eac-8ead-2acd1c26453e service nova] Enqueued Resource ID: abb7f382-0834-4984-98c9-82d36651f452 with Priority: HIGHEST for action security_group_rules [ 981.586990] env[69188]: INFO networking_nsxv3.common.synchronization [req-5893dc44-c15b-4114-acb7-edb75c3fb247 req-4cc5a94f-4143-4eac-8ead-2acd1c26453e service nova] Enqueued Resource ID: abb7f382-0834-4984-98c9-82d36651f452 with Priority: HIGHEST for action security_group_members [ 981.586990] env[69188]: INFO networking_nsxv3.common.synchronization [req-5893dc44-c15b-4114-acb7-edb75c3fb247 req-4cc5a94f-4143-4eac-8ead-2acd1c26453e service nova] Enqueued Resource ID: cca83c4c-51e2-4809-a82a-3b24bd3c8bef with Priority: HIGHEST for action port [ 981.586990] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: abb7f382-0834-4984-98c9-82d36651f452 with Priority: HIGHEST for action security_group_rules [ 981.586990] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: abb7f382-0834-4984-98c9-82d36651f452 with Priority: HIGHEST for action security_group_members [ 981.586990] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cca83c4c-51e2-4809-a82a-3b24bd3c8bef with Priority: HIGHEST for action port [ 981.586990] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-abb7f382-0834-4984-98c9-82d36651f452 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.586990] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-abb7f382-0834-4984-98c9-82d36651f452" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.586990] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-abb7f382-0834-4984-98c9-82d36651f452" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.586990] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-abb7f382-0834-4984-98c9-82d36651f452" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.586990] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('abb7f382-0834-4984-98c9-82d36651f452',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 981.586990] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-abb7f382-0834-4984-98c9-82d36651f452 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.586990] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-abb7f382-0834-4984-98c9-82d36651f452" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.586990] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-abb7f382-0834-4984-98c9-82d36651f452" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.587710] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-abb7f382-0834-4984-98c9-82d36651f452" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.587710] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.587710] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.587710] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.587710] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.587880] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.587880] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('abb7f382-0834-4984-98c9-82d36651f452',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 981.588672] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-cca83c4c-51e2-4809-a82a-3b24bd3c8bef taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.589302] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cca83c4c-51e2-4809-a82a-3b24bd3c8bef" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.589302] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cca83c4c-51e2-4809-a82a-3b24bd3c8bef" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.589302] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cca83c4c-51e2-4809-a82a-3b24bd3c8bef" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.589505] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cca83c4c-51e2-4809-a82a-3b24bd3c8bef',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 982.091530] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-abb7f382-0834-4984-98c9-82d36651f452 taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.091667] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-abb7f382-0834-4984-98c9-82d36651f452" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.091859] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port cca83c4c-51e2-4809-a82a-3b24bd3c8bef with status ACTIVE [ 982.092097] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.092223] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.092293] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.092488] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.092583] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.092755] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.093252] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.093252] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.093252] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.093252] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.093418] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.093418] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.093494] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.093706] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.093706] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.093812] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: cca83c4c-51e2-4809-a82a-3b24bd3c8bef is going to be updated. [ 982.094774] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('abb7f382-0834-4984-98c9-82d36651f452',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 982.113611] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.113748] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.113832] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.114016] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.114194] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.114303] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cca83c4c-51e2-4809-a82a-3b24bd3c8bef" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.150885] env[69188]: INFO networking_nsxv3.common.synchronization [None req-2510df90-1973-403c-8e19-25b0f33d33b8 tempest-ServerDiskConfigTestJSON-1476779099 tempest-ServerDiskConfigTestJSON-1476779099-project-member] Enqueued Resource ID: e3fc6f81-b251-4660-b48b-53c0dab9023a with Priority: HIGHEST for action security_group_rules [ 982.150885] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e3fc6f81-b251-4660-b48b-53c0dab9023a with Priority: HIGHEST for action security_group_rules [ 982.151095] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e3fc6f81-b251-4660-b48b-53c0dab9023a taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.151207] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e3fc6f81-b251-4660-b48b-53c0dab9023a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.151207] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e3fc6f81-b251-4660-b48b-53c0dab9023a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.151442] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e3fc6f81-b251-4660-b48b-53c0dab9023a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.151522] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e3fc6f81-b251-4660-b48b-53c0dab9023a',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 982.269166] env[69188]: INFO networking_nsxv3.common.synchronization [None req-3b928599-db89-45db-af16-517502ac856a tempest-ServerDiskConfigTestJSON-1476779099 tempest-ServerDiskConfigTestJSON-1476779099-project-member] Enqueued Resource ID: e3fc6f81-b251-4660-b48b-53c0dab9023a with Priority: HIGHEST for action security_group_rules [ 982.269666] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e3fc6f81-b251-4660-b48b-53c0dab9023a with Priority: HIGHEST for action security_group_rules [ 982.269977] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e3fc6f81-b251-4660-b48b-53c0dab9023a taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.270104] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e3fc6f81-b251-4660-b48b-53c0dab9023a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.596599] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('abb7f382-0834-4984-98c9-82d36651f452',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 982.670354] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.670502] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.670577] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.670801] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.670895] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.670993] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e3fc6f81-b251-4660-b48b-53c0dab9023a already deleted. [ 982.671239] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e3fc6f81-b251-4660-b48b-53c0dab9023a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.671239] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e3fc6f81-b251-4660-b48b-53c0dab9023a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.671385] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e3fc6f81-b251-4660-b48b-53c0dab9023a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.671469] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e3fc6f81-b251-4660-b48b-53c0dab9023a',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 983.100462] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.100462] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.100462] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.100462] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.100462] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.100462] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: abb7f382-0834-4984-98c9-82d36651f452 is going to be created. [ 983.127586] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.127586] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.127586] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.129592] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.129592] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.146591] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: abb7f382-0834-4984-98c9-82d36651f452 in Status: UNINITIALIZED for 2s [ 983.192121] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.192377] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.192446] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.192638] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.192742] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.192840] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e3fc6f81-b251-4660-b48b-53c0dab9023a already deleted. [ 983.192920] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e3fc6f81-b251-4660-b48b-53c0dab9023a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.237804] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 397559b2-3c5a-424d-b09d-43a25d2abba6 in Status: SUCCESS [ 983.238019] env[69188]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 397559b2-3c5a-424d-b09d-43a25d2abba6 deletion is rescheduled due to dependency. [ 983.238141] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-397559b2-3c5a-424d-b09d-43a25d2abba6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.325504] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 721e26e3-d896-46ab-b5a3-92852a365813 in Status: SUCCESS [ 983.325504] env[69188]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 721e26e3-d896-46ab-b5a3-92852a365813 deletion is rescheduled due to dependency. [ 983.325795] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-721e26e3-d896-46ab-b5a3-92852a365813" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.155682] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: abb7f382-0834-4984-98c9-82d36651f452 in Status: SUCCESS [ 985.156011] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-abb7f382-0834-4984-98c9-82d36651f452" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.156285] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-abb7f382-0834-4984-98c9-82d36651f452" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.156405] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-abb7f382-0834-4984-98c9-82d36651f452" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.156611] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.156720] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.156786] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.156939] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.157033] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.157121] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-abb7f382-0834-4984-98c9-82d36651f452" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.157213] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('abb7f382-0834-4984-98c9-82d36651f452',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 985.201464] env[69188]: INFO networking_nsxv3.common.synchronization [req-1b64d130-304c-4448-b81b-6a430f65f29e req-a2af44d1-b894-4816-848c-483d2e6a33b2 tempest-ServerDiskConfigTestJSON-1476779099 tempest-ServerDiskConfigTestJSON-1476779099-project-member] Enqueued Resource ID: 24a7b083-b432-46d6-94de-76adf6ce22b3 with Priority: HIGHEST for action security_group_members [ 985.202283] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 24a7b083-b432-46d6-94de-76adf6ce22b3 with Priority: HIGHEST for action security_group_members [ 985.202944] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-24a7b083-b432-46d6-94de-76adf6ce22b3 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.202944] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-24a7b083-b432-46d6-94de-76adf6ce22b3" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.202944] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-24a7b083-b432-46d6-94de-76adf6ce22b3" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.202944] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-24a7b083-b432-46d6-94de-76adf6ce22b3" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.204120] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.204269] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.204342] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.204513] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.204603] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.204700] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('24a7b083-b432-46d6-94de-76adf6ce22b3',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 985.660301] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-abb7f382-0834-4984-98c9-82d36651f452 taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.660301] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-abb7f382-0834-4984-98c9-82d36651f452" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.660301] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-abb7f382-0834-4984-98c9-82d36651f452" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.660301] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-abb7f382-0834-4984-98c9-82d36651f452" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.660568] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.660626] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.660657] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.660833] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.660935] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.661037] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-abb7f382-0834-4984-98c9-82d36651f452" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.661196] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-abb7f382-0834-4984-98c9-82d36651f452 taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.661325] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-abb7f382-0834-4984-98c9-82d36651f452" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.661396] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-abb7f382-0834-4984-98c9-82d36651f452" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.661543] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-abb7f382-0834-4984-98c9-82d36651f452" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.661682] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.661786] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.661883] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.661991] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.662088] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.662206] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-abb7f382-0834-4984-98c9-82d36651f452" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.662301] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('abb7f382-0834-4984-98c9-82d36651f452',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 985.708465] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.708634] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.708721] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.709015] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.730023] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.730023] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.730023] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.730023] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.730023] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.730023] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.730023] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 24a7b083-b432-46d6-94de-76adf6ce22b3 is going to be updated. [ 985.752625] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.752800] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.752842] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.753051] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.754184] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.761698] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 24a7b083-b432-46d6-94de-76adf6ce22b3 in Status: IN_PROGRESS for 2s [ 986.164384] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for abb7f382-0834-4984-98c9-82d36651f452: rpc.has_security_group_logging(os_id): False [ 986.181252] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.181427] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.181485] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.181661] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.181751] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.181966] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.182079] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.182146] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.182298] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.182375] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.182547] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.182639] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.182711] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.182851] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.182925] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.183371] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.183371] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.183371] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.183540] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.183540] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.183540] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: abb7f382-0834-4984-98c9-82d36651f452 is going to be created. [ 986.236152] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.236374] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.236460] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.236738] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.236956] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.247119] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: abb7f382-0834-4984-98c9-82d36651f452 in Status: IN_PROGRESS for 2s [ 987.695409] env[69188]: INFO networking_nsxv3.common.synchronization [None req-c1351c84-54ad-43d6-8be8-9dcc92d97593 tempest-ServerRescueNegativeTestJSON-1937748911 tempest-ServerRescueNegativeTestJSON-1937748911-project-member] Enqueued Resource ID: e3296f55-96ac-44eb-a498-8c6ab147c5ab with Priority: HIGHEST for action security_group_rules [ 987.695935] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e3296f55-96ac-44eb-a498-8c6ab147c5ab with Priority: HIGHEST for action security_group_rules [ 987.696367] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e3296f55-96ac-44eb-a498-8c6ab147c5ab taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.696508] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e3296f55-96ac-44eb-a498-8c6ab147c5ab" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.696640] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e3296f55-96ac-44eb-a498-8c6ab147c5ab" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.696904] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e3296f55-96ac-44eb-a498-8c6ab147c5ab" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.696982] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e3296f55-96ac-44eb-a498-8c6ab147c5ab',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 987.768800] env[69188]: INFO networking_nsxv3.common.synchronization [None req-2ac8ff85-4aaf-4e64-ac7e-b37776048653 tempest-ServerRescueNegativeTestJSON-1937748911 tempest-ServerRescueNegativeTestJSON-1937748911-project-member] Enqueued Resource ID: e3296f55-96ac-44eb-a498-8c6ab147c5ab with Priority: HIGHEST for action security_group_rules [ 987.770443] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e3296f55-96ac-44eb-a498-8c6ab147c5ab with Priority: HIGHEST for action security_group_rules [ 987.770715] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e3296f55-96ac-44eb-a498-8c6ab147c5ab taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.770844] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e3296f55-96ac-44eb-a498-8c6ab147c5ab" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.776919] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 24a7b083-b432-46d6-94de-76adf6ce22b3 in Status: SUCCESS [ 987.776919] env[69188]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 24a7b083-b432-46d6-94de-76adf6ce22b3 deletion is rescheduled due to dependency. [ 987.776919] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-24a7b083-b432-46d6-94de-76adf6ce22b3" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.216277] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.219296] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.219296] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.219296] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.219296] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.219296] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e3296f55-96ac-44eb-a498-8c6ab147c5ab already deleted. [ 988.219296] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e3296f55-96ac-44eb-a498-8c6ab147c5ab" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.219296] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e3296f55-96ac-44eb-a498-8c6ab147c5ab" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.219296] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e3296f55-96ac-44eb-a498-8c6ab147c5ab" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.219296] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e3296f55-96ac-44eb-a498-8c6ab147c5ab',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 988.257202] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: abb7f382-0834-4984-98c9-82d36651f452 in Status: SUCCESS [ 988.257435] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-abb7f382-0834-4984-98c9-82d36651f452" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.739628] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.739849] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.739849] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.740387] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.740493] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.740601] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e3296f55-96ac-44eb-a498-8c6ab147c5ab already deleted. [ 988.740695] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e3296f55-96ac-44eb-a498-8c6ab147c5ab" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.797660] env[69188]: INFO networking_nsxv3.common.synchronization [req-def9482d-98d0-4711-bd1a-fcd32fc3bed4 req-93571a05-ff2f-4310-b422-f53b780675be tempest-ServersAdminTestJSON-1988649207 tempest-ServersAdminTestJSON-1988649207-project-member] Enqueued Resource ID: 5e76d42e-7ec6-4a5e-aa9c-c5a285d62318 with Priority: HIGHEST for action security_group_members [ 989.798172] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e76d42e-7ec6-4a5e-aa9c-c5a285d62318 with Priority: HIGHEST for action security_group_members [ 989.798535] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e76d42e-7ec6-4a5e-aa9c-c5a285d62318 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.798649] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e76d42e-7ec6-4a5e-aa9c-c5a285d62318" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.798719] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e76d42e-7ec6-4a5e-aa9c-c5a285d62318" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.798910] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e76d42e-7ec6-4a5e-aa9c-c5a285d62318" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.799273] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.799378] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.799441] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.799605] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.799731] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.799835] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5e76d42e-7ec6-4a5e-aa9c-c5a285d62318',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 990.167206] env[69188]: INFO networking_nsxv3.common.synchronization [req-68338bc3-c1d5-4863-8bff-46bd2f4aa8b5 req-bb04286c-3521-4927-97de-6c33d4d8bdf9 tempest-ImagesTestJSON-2034330654 tempest-ImagesTestJSON-2034330654-project-member] Enqueued Resource ID: 199db626-eef5-4a20-b92a-585841c1cff4 with Priority: HIGHEST for action security_group_members [ 990.167700] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 199db626-eef5-4a20-b92a-585841c1cff4 with Priority: HIGHEST for action security_group_members [ 990.168024] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-199db626-eef5-4a20-b92a-585841c1cff4 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.168492] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-199db626-eef5-4a20-b92a-585841c1cff4" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.168588] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-199db626-eef5-4a20-b92a-585841c1cff4" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.168766] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-199db626-eef5-4a20-b92a-585841c1cff4" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.168932] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.169171] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.169262] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.169422] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.169504] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.169595] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('199db626-eef5-4a20-b92a-585841c1cff4',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 990.302400] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5e76d42e-7ec6-4a5e-aa9c-c5a285d62318',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 990.522504] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock network-410 taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.522732] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "network-410" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.522861] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "network-410" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.523165] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "network-410" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.523439] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.523599] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.523720] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.523966] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.524207] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.524482] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 990.524635] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] NeedRegenerationException {{(pid=69188) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 990.524786] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] no value, waiting for create lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 990.524924] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] value creation lock acquired {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 990.525074] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 990.525218] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Calling creation function for not-yet-present value {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 990.525379] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 990.544464] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 990.544643] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69188) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 990.544786] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Released creation lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 990.544965] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "network-410" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.545294] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock port-a182204e-10a5-4dd5-966a-45041d4e3861 taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.545472] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "port-a182204e-10a5-4dd5-966a-45041d4e3861" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.545597] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "port-a182204e-10a5-4dd5-966a-45041d4e3861" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.545913] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "port-a182204e-10a5-4dd5-966a-45041d4e3861" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.546065] env[69188]: DEBUG networking_nsxv3.api.rpc [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a182204e-10a5-4dd5-966a-45041d4e3861',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 990.671077] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('199db626-eef5-4a20-b92a-585841c1cff4',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 990.805563] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5e76d42e-7ec6-4a5e-aa9c-c5a285d62318',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 991.049090] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.049295] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.049295] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.049587] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.049760] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.049923] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Segment Port a182204e-10a5-4dd5-966a-45041d4e3861 not found, creating... [ 991.050234] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.050410] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.050534] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.050830] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.050949] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.051212] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.051377] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.051498] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.051715] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.051854] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.052012] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Resource: SegmentPort with ID: a182204e-10a5-4dd5-966a-45041d4e3861 is going to be created. [ 991.071464] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.071679] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.071819] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.072107] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.072358] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.072594] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "port-a182204e-10a5-4dd5-966a-45041d4e3861" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.176948] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('199db626-eef5-4a20-b92a-585841c1cff4',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 991.308255] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.308413] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.308477] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.310899] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.310899] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.310899] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5e76d42e-7ec6-4a5e-aa9c-c5a285d62318 is going to be updated. [ 991.342314] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.342514] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.342599] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.342795] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.343426] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.352419] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5e76d42e-7ec6-4a5e-aa9c-c5a285d62318 in Status: IN_PROGRESS for 2s [ 991.679662] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.679876] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.679922] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.680226] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.680301] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.680502] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 199db626-eef5-4a20-b92a-585841c1cff4 is going to be updated. [ 991.708519] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.708519] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.708714] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.708794] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.709047] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.733523] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 199db626-eef5-4a20-b92a-585841c1cff4 in Status: IN_PROGRESS for 2s [ 991.761337] env[69188]: INFO networking_nsxv3.common.synchronization [req-68338bc3-c1d5-4863-8bff-46bd2f4aa8b5 req-e9ba1ecd-0615-4938-a851-c6761df8a611 service nova] Enqueued Resource ID: 199db626-eef5-4a20-b92a-585841c1cff4 with Priority: HIGHEST for action security_group_rules [ 991.761587] env[69188]: INFO networking_nsxv3.common.synchronization [req-68338bc3-c1d5-4863-8bff-46bd2f4aa8b5 req-e9ba1ecd-0615-4938-a851-c6761df8a611 service nova] Enqueued Resource ID: 199db626-eef5-4a20-b92a-585841c1cff4 with Priority: HIGHEST for action security_group_members [ 991.761716] env[69188]: INFO networking_nsxv3.common.synchronization [req-68338bc3-c1d5-4863-8bff-46bd2f4aa8b5 req-e9ba1ecd-0615-4938-a851-c6761df8a611 service nova] Enqueued Resource ID: a182204e-10a5-4dd5-966a-45041d4e3861 with Priority: HIGHEST for action port [ 991.761950] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 199db626-eef5-4a20-b92a-585841c1cff4 with Priority: HIGHEST for action security_group_rules [ 991.762089] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 199db626-eef5-4a20-b92a-585841c1cff4 with Priority: HIGHEST for action security_group_members [ 991.762187] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a182204e-10a5-4dd5-966a-45041d4e3861 with Priority: HIGHEST for action port [ 991.762785] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-199db626-eef5-4a20-b92a-585841c1cff4 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.762841] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-199db626-eef5-4a20-b92a-585841c1cff4" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.762902] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-199db626-eef5-4a20-b92a-585841c1cff4" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.763438] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-199db626-eef5-4a20-b92a-585841c1cff4" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.763640] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('199db626-eef5-4a20-b92a-585841c1cff4',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 991.765113] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-199db626-eef5-4a20-b92a-585841c1cff4 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.765113] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-199db626-eef5-4a20-b92a-585841c1cff4" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.765471] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-a182204e-10a5-4dd5-966a-45041d4e3861 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.765775] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a182204e-10a5-4dd5-966a-45041d4e3861" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.765775] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a182204e-10a5-4dd5-966a-45041d4e3861" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.766177] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a182204e-10a5-4dd5-966a-45041d4e3861" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.767011] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a182204e-10a5-4dd5-966a-45041d4e3861',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 992.270431] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-199db626-eef5-4a20-b92a-585841c1cff4 taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.270431] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-199db626-eef5-4a20-b92a-585841c1cff4" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.270915] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a182204e-10a5-4dd5-966a-45041d4e3861 with status ACTIVE [ 992.270915] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.271013] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.271274] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.271407] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.271459] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.271630] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.271722] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.271780] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.271998] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.271998] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.272185] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.272280] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.272332] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.272452] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.272515] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.272625] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a182204e-10a5-4dd5-966a-45041d4e3861 is going to be updated. [ 992.294140] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.294395] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.294395] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.294591] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.294725] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.294877] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a182204e-10a5-4dd5-966a-45041d4e3861" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.361152] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5e76d42e-7ec6-4a5e-aa9c-c5a285d62318 in Status: SUCCESS [ 993.361421] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e76d42e-7ec6-4a5e-aa9c-c5a285d62318" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.743174] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 199db626-eef5-4a20-b92a-585841c1cff4 in Status: SUCCESS [ 993.743390] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-199db626-eef5-4a20-b92a-585841c1cff4" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.743552] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-199db626-eef5-4a20-b92a-585841c1cff4" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.743768] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-199db626-eef5-4a20-b92a-585841c1cff4" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.743967] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.744101] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.744168] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.744320] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.744396] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.744492] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('199db626-eef5-4a20-b92a-585841c1cff4',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.248334] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('199db626-eef5-4a20-b92a-585841c1cff4',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.749321] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('199db626-eef5-4a20-b92a-585841c1cff4',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 995.253795] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.253795] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.253795] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.253795] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.253795] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.253795] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 199db626-eef5-4a20-b92a-585841c1cff4 is going to be updated. [ 995.277058] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.277231] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.277305] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.277522] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.277662] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.285537] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 199db626-eef5-4a20-b92a-585841c1cff4 in Status: IN_PROGRESS for 2s [ 995.362096] env[69188]: INFO networking_nsxv3.common.synchronization [req-b304bc52-ad75-417e-b2a9-eafafc83a66a req-e13c9c1f-b453-4b87-984e-6467942c13b6 tempest-ServersNegativeTestMultiTenantJSON-1069831443 tempest-ServersNegativeTestMultiTenantJSON-1069831443-project-member] Enqueued Resource ID: abb7f382-0834-4984-98c9-82d36651f452 with Priority: HIGHEST for action security_group_members [ 995.362593] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: abb7f382-0834-4984-98c9-82d36651f452 with Priority: HIGHEST for action security_group_members [ 995.362916] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-abb7f382-0834-4984-98c9-82d36651f452 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.363020] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-abb7f382-0834-4984-98c9-82d36651f452" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.363091] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-abb7f382-0834-4984-98c9-82d36651f452" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.363296] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-abb7f382-0834-4984-98c9-82d36651f452" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.363452] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.363552] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.363613] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.363752] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.363838] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.363928] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('abb7f382-0834-4984-98c9-82d36651f452',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 995.873689] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.874008] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.874008] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.876511] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.876511] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.876511] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.876511] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.876511] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.876511] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.876511] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.876511] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: abb7f382-0834-4984-98c9-82d36651f452 is going to be updated. [ 995.902172] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.902688] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.902769] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.902985] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.903481] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.914362] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: abb7f382-0834-4984-98c9-82d36651f452 in Status: IN_PROGRESS for 2s [ 997.206026] env[69188]: INFO networking_nsxv3.common.synchronization [None req-47d1642c-82f1-4430-873d-ba6b1fd47624 None None] Enqueued Resource ID: c47cad6c-cfd7-4b75-b876-fd92d45ae842 with Priority: HIGHEST for action port [ 997.206026] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c47cad6c-cfd7-4b75-b876-fd92d45ae842 with Priority: HIGHEST for action port [ 997.206026] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-c47cad6c-cfd7-4b75-b876-fd92d45ae842 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.206026] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c47cad6c-cfd7-4b75-b876-fd92d45ae842" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.206026] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c47cad6c-cfd7-4b75-b876-fd92d45ae842" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.206026] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c47cad6c-cfd7-4b75-b876-fd92d45ae842" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.206026] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c47cad6c-cfd7-4b75-b876-fd92d45ae842',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 997.297175] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 199db626-eef5-4a20-b92a-585841c1cff4 in Status: SUCCESS [ 997.297404] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-199db626-eef5-4a20-b92a-585841c1cff4" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.297585] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-199db626-eef5-4a20-b92a-585841c1cff4" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.297793] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-199db626-eef5-4a20-b92a-585841c1cff4" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.297982] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.298109] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.298179] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.298325] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.298404] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.298488] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-199db626-eef5-4a20-b92a-585841c1cff4" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.298577] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('199db626-eef5-4a20-b92a-585841c1cff4',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 997.708328] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c47cad6c-cfd7-4b75-b876-fd92d45ae842 [ 997.708586] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.708728] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.708811] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.709091] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.709209] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.709324] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c47cad6c-cfd7-4b75-b876-fd92d45ae842 already deleted. [ 997.709410] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c47cad6c-cfd7-4b75-b876-fd92d45ae842" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.801583] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-199db626-eef5-4a20-b92a-585841c1cff4 taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.801831] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-199db626-eef5-4a20-b92a-585841c1cff4" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.801831] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-199db626-eef5-4a20-b92a-585841c1cff4" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.802016] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-199db626-eef5-4a20-b92a-585841c1cff4" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.802182] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.802282] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.802348] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.802496] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.803259] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.803259] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-199db626-eef5-4a20-b92a-585841c1cff4" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.803259] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-199db626-eef5-4a20-b92a-585841c1cff4 taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.803259] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-199db626-eef5-4a20-b92a-585841c1cff4" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.803259] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-199db626-eef5-4a20-b92a-585841c1cff4" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.803259] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-199db626-eef5-4a20-b92a-585841c1cff4" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.803259] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.803646] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.803646] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.803646] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.803646] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.803646] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-199db626-eef5-4a20-b92a-585841c1cff4" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.803842] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('199db626-eef5-4a20-b92a-585841c1cff4',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 997.925767] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: abb7f382-0834-4984-98c9-82d36651f452 in Status: SUCCESS [ 997.926017] env[69188]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: abb7f382-0834-4984-98c9-82d36651f452 deletion is rescheduled due to dependency. [ 997.926173] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-abb7f382-0834-4984-98c9-82d36651f452" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.306747] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 199db626-eef5-4a20-b92a-585841c1cff4: rpc.has_security_group_logging(os_id): False [ 998.323960] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.325100] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.325100] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.325100] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.325100] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.325100] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.325100] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.325100] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.325100] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.325100] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.325522] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.325522] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.325522] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.325522] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.325648] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.326453] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.326453] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.326453] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.326453] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.326453] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.326453] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 199db626-eef5-4a20-b92a-585841c1cff4 is going to be updated. [ 998.382814] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.382959] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.384238] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.384543] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.384731] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.399490] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 199db626-eef5-4a20-b92a-585841c1cff4 in Status: IN_PROGRESS for 2s [ 999.469193] env[69188]: INFO networking_nsxv3.common.synchronization [None req-0182edeb-30a0-4770-8e2a-d3b89a9d9ff9 None None] Enqueued Resource ID: 0fe92e1f-a14b-420f-bced-f212bbc7ac56 with Priority: HIGHEST for action port [ 999.469734] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0fe92e1f-a14b-420f-bced-f212bbc7ac56 with Priority: HIGHEST for action port [ 999.470129] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-0fe92e1f-a14b-420f-bced-f212bbc7ac56 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.470248] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0fe92e1f-a14b-420f-bced-f212bbc7ac56" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.470296] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0fe92e1f-a14b-420f-bced-f212bbc7ac56" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.470570] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0fe92e1f-a14b-420f-bced-f212bbc7ac56" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.471446] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0fe92e1f-a14b-420f-bced-f212bbc7ac56',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 999.974027] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0fe92e1f-a14b-420f-bced-f212bbc7ac56 [ 999.974292] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.974423] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.974493] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.975412] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.975412] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.975412] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0fe92e1f-a14b-420f-bced-f212bbc7ac56 already deleted. [ 999.975412] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0fe92e1f-a14b-420f-bced-f212bbc7ac56" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.414294] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 199db626-eef5-4a20-b92a-585841c1cff4 in Status: SUCCESS [ 1000.414542] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-199db626-eef5-4a20-b92a-585841c1cff4" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.717061] env[69188]: INFO networking_nsxv3.common.synchronization [req-1f1d9866-f602-4f6a-8eeb-ef8e2d42d896 req-959d274f-8a1a-4bb5-a520-92503d8f046b tempest-AttachInterfacesTestJSON-1255877948 tempest-AttachInterfacesTestJSON-1255877948-project-member] Enqueued Resource ID: 048d5e2e-adfe-4bc0-9ae5-f6d99d633e62 with Priority: HIGHEST for action security_group_members [ 1002.718583] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 048d5e2e-adfe-4bc0-9ae5-f6d99d633e62 with Priority: HIGHEST for action security_group_members [ 1002.718583] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-048d5e2e-adfe-4bc0-9ae5-f6d99d633e62 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.718583] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-048d5e2e-adfe-4bc0-9ae5-f6d99d633e62" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.718583] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-048d5e2e-adfe-4bc0-9ae5-f6d99d633e62" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.718897] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-048d5e2e-adfe-4bc0-9ae5-f6d99d633e62" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.718897] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.719877] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.719877] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.719877] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.719877] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.719877] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('048d5e2e-adfe-4bc0-9ae5-f6d99d633e62',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.221754] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.221923] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.222007] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.222258] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.222355] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.222555] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.222754] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.222754] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.222863] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.222941] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.223039] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 048d5e2e-adfe-4bc0-9ae5-f6d99d633e62 already deleted. [ 1003.223131] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-048d5e2e-adfe-4bc0-9ae5-f6d99d633e62" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.283132] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock network-51 taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.283363] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "network-51" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.283496] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "network-51" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.283829] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "network-51" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.284571] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.284773] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.284902] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.285170] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.285341] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.285560] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1003.285679] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] NeedRegenerationException {{(pid=69188) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1003.285794] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] no value, waiting for create lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1003.285908] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] value creation lock acquired {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1003.286034] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1003.286151] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Calling creation function for not-yet-present value {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1003.286375] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1003.307988] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1003.308192] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69188) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1003.308341] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Released creation lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1003.308528] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "network-51" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.308869] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock port-6a208557-e9af-4de5-8bfc-956db8ac4308 taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.310498] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "port-6a208557-e9af-4de5-8bfc-956db8ac4308" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.310498] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "port-6a208557-e9af-4de5-8bfc-956db8ac4308" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.310498] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "port-6a208557-e9af-4de5-8bfc-956db8ac4308" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.310498] env[69188]: DEBUG networking_nsxv3.api.rpc [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6a208557-e9af-4de5-8bfc-956db8ac4308',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.817048] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.817048] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.817048] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.817048] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.817048] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.817048] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Segment Port 6a208557-e9af-4de5-8bfc-956db8ac4308 not found, creating... [ 1003.817048] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.817048] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.817048] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.817048] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.817048] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.817751] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.817921] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.818267] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.818674] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.818926] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.819207] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Resource: SegmentPort with ID: 6a208557-e9af-4de5-8bfc-956db8ac4308 is going to be created. [ 1003.843023] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.843023] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.843023] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.843023] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.843023] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.843023] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "port-6a208557-e9af-4de5-8bfc-956db8ac4308" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.768595] env[69188]: INFO networking_nsxv3.common.synchronization [None req-be5af491-00db-40cd-9cdf-9f13fece1f4f None None] Enqueued Resource ID: 19950597-4732-491e-b1f5-b1e2affb51fe with Priority: HIGHEST for action port [ 1004.769222] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 19950597-4732-491e-b1f5-b1e2affb51fe with Priority: HIGHEST for action port [ 1004.769581] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-19950597-4732-491e-b1f5-b1e2affb51fe taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.769719] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-19950597-4732-491e-b1f5-b1e2affb51fe" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.769793] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-19950597-4732-491e-b1f5-b1e2affb51fe" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.770820] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-19950597-4732-491e-b1f5-b1e2affb51fe" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.770938] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('19950597-4732-491e-b1f5-b1e2affb51fe',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.021845] env[69188]: INFO networking_nsxv3.common.synchronization [req-1f1d9866-f602-4f6a-8eeb-ef8e2d42d896 req-ebc31298-0283-4343-afba-49239adc1352 service nova] Enqueued Resource ID: 048d5e2e-adfe-4bc0-9ae5-f6d99d633e62 with Priority: HIGHEST for action security_group_rules [ 1005.022126] env[69188]: INFO networking_nsxv3.common.synchronization [req-1f1d9866-f602-4f6a-8eeb-ef8e2d42d896 req-ebc31298-0283-4343-afba-49239adc1352 service nova] Enqueued Resource ID: 048d5e2e-adfe-4bc0-9ae5-f6d99d633e62 with Priority: HIGHEST for action security_group_members [ 1005.022176] env[69188]: INFO networking_nsxv3.common.synchronization [req-1f1d9866-f602-4f6a-8eeb-ef8e2d42d896 req-ebc31298-0283-4343-afba-49239adc1352 service nova] Enqueued Resource ID: 6a208557-e9af-4de5-8bfc-956db8ac4308 with Priority: HIGHEST for action port [ 1005.022411] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 048d5e2e-adfe-4bc0-9ae5-f6d99d633e62 with Priority: HIGHEST for action security_group_rules [ 1005.022539] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 048d5e2e-adfe-4bc0-9ae5-f6d99d633e62 with Priority: HIGHEST for action security_group_members [ 1005.022634] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6a208557-e9af-4de5-8bfc-956db8ac4308 with Priority: HIGHEST for action port [ 1005.023223] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-048d5e2e-adfe-4bc0-9ae5-f6d99d633e62 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.023349] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-048d5e2e-adfe-4bc0-9ae5-f6d99d633e62" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.023656] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-048d5e2e-adfe-4bc0-9ae5-f6d99d633e62" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.023656] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-048d5e2e-adfe-4bc0-9ae5-f6d99d633e62" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.023733] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('048d5e2e-adfe-4bc0-9ae5-f6d99d633e62',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.024506] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-048d5e2e-adfe-4bc0-9ae5-f6d99d633e62 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.024659] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-048d5e2e-adfe-4bc0-9ae5-f6d99d633e62" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.024746] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-048d5e2e-adfe-4bc0-9ae5-f6d99d633e62" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.024907] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-048d5e2e-adfe-4bc0-9ae5-f6d99d633e62" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.025069] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.025165] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.025228] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.025363] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.025445] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.025530] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('048d5e2e-adfe-4bc0-9ae5-f6d99d633e62',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.026274] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-6a208557-e9af-4de5-8bfc-956db8ac4308 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.026373] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6a208557-e9af-4de5-8bfc-956db8ac4308" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.026438] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6a208557-e9af-4de5-8bfc-956db8ac4308" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.026589] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6a208557-e9af-4de5-8bfc-956db8ac4308" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.026677] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6a208557-e9af-4de5-8bfc-956db8ac4308',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.175944] env[69188]: INFO networking_nsxv3.common.synchronization [req-978f7fa5-ce86-4c2c-b5ae-0b4219775816 req-d1c4075b-509a-46b2-b8f1-6b1f701094b9 tempest-ServersTestJSON-1495057482 tempest-ServersTestJSON-1495057482-project-member] Enqueued Resource ID: 9f2518e8-b195-4520-b262-caa765ab7e27 with Priority: HIGHEST for action security_group_members [ 1005.176635] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f2518e8-b195-4520-b262-caa765ab7e27 with Priority: HIGHEST for action security_group_members [ 1005.178419] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-9f2518e8-b195-4520-b262-caa765ab7e27 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.178663] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9f2518e8-b195-4520-b262-caa765ab7e27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.178809] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9f2518e8-b195-4520-b262-caa765ab7e27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.183023] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9f2518e8-b195-4520-b262-caa765ab7e27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.183023] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.183023] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.183023] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.183023] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.183023] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.183023] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9f2518e8-b195-4520-b262-caa765ab7e27',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.273831] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 19950597-4732-491e-b1f5-b1e2affb51fe [ 1005.274087] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.274225] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.274293] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.274502] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.274589] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.274679] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:19950597-4732-491e-b1f5-b1e2affb51fe already deleted. [ 1005.274756] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-19950597-4732-491e-b1f5-b1e2affb51fe" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.526335] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock network-507 taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.526542] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "network-507" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.526858] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "network-507" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.527173] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "network-507" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.527966] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.531887] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.531887] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.531887] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.531887] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.531887] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1005.531887] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] NeedRegenerationException {{(pid=69188) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1005.531887] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] no value, waiting for create lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1005.531887] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] value creation lock acquired {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1005.531887] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1005.531887] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Calling creation function for not-yet-present value {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1005.531887] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1005.531887] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-048d5e2e-adfe-4bc0-9ae5-f6d99d633e62 taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.531887] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-048d5e2e-adfe-4bc0-9ae5-f6d99d633e62" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.531887] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('048d5e2e-adfe-4bc0-9ae5-f6d99d633e62',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.532586] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6a208557-e9af-4de5-8bfc-956db8ac4308 with status ACTIVE [ 1005.533246] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.533246] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.533246] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.533246] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.533465] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.533592] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.537074] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.537177] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.537381] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.537486] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.537706] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.537822] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.537886] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.538107] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.538207] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.538297] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6a208557-e9af-4de5-8bfc-956db8ac4308 is going to be updated. [ 1005.566311] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1005.566538] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Cache value generated in 0.037 seconds for key(s): 'zone-id' {{(pid=69188) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1005.566720] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Released creation lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1005.566928] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "network-507" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.567296] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock port-9e2402e4-d91c-4921-815e-0d5aabda4d53 taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.567518] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "port-9e2402e4-d91c-4921-815e-0d5aabda4d53" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.567703] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "port-9e2402e4-d91c-4921-815e-0d5aabda4d53" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.568182] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "port-9e2402e4-d91c-4921-815e-0d5aabda4d53" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.568368] env[69188]: DEBUG networking_nsxv3.api.rpc [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9e2402e4-d91c-4921-815e-0d5aabda4d53',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.573020] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.573020] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.573020] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.573020] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.573020] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.573020] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6a208557-e9af-4de5-8bfc-956db8ac4308" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.684873] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9f2518e8-b195-4520-b262-caa765ab7e27',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.040168] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('048d5e2e-adfe-4bc0-9ae5-f6d99d633e62',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.071152] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.071372] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.071528] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.071817] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.071969] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.072135] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Segment Port 9e2402e4-d91c-4921-815e-0d5aabda4d53 not found, creating... [ 1006.072394] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.072550] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.072668] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.072887] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.073035] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.073331] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.073486] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.073602] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.073808] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.073939] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.074095] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Resource: SegmentPort with ID: 9e2402e4-d91c-4921-815e-0d5aabda4d53 is going to be created. [ 1006.094567] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.094775] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.094901] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.095190] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.095411] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.095635] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "port-9e2402e4-d91c-4921-815e-0d5aabda4d53" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.186852] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9f2518e8-b195-4520-b262-caa765ab7e27',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.543573] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.543745] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.543795] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.544028] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.544117] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.544224] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 048d5e2e-adfe-4bc0-9ae5-f6d99d633e62 is going to be created. [ 1006.571238] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.572867] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.572867] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.572867] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.572867] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.584686] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 048d5e2e-adfe-4bc0-9ae5-f6d99d633e62 in Status: UNINITIALIZED for 2s [ 1006.691612] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.691719] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.691794] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.692019] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.692164] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.692211] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9f2518e8-b195-4520-b262-caa765ab7e27 is going to be updated. [ 1006.731267] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.731433] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.731487] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.731700] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.731843] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.741969] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9f2518e8-b195-4520-b262-caa765ab7e27 in Status: IN_PROGRESS for 2s [ 1006.795491] env[69188]: INFO networking_nsxv3.common.synchronization [req-978f7fa5-ce86-4c2c-b5ae-0b4219775816 req-1ed66daf-2530-4420-99b8-77dd6cd58c22 service nova] Enqueued Resource ID: 9f2518e8-b195-4520-b262-caa765ab7e27 with Priority: HIGHEST for action security_group_rules [ 1006.795734] env[69188]: INFO networking_nsxv3.common.synchronization [req-978f7fa5-ce86-4c2c-b5ae-0b4219775816 req-1ed66daf-2530-4420-99b8-77dd6cd58c22 service nova] Enqueued Resource ID: 9f2518e8-b195-4520-b262-caa765ab7e27 with Priority: HIGHEST for action security_group_members [ 1006.795837] env[69188]: INFO networking_nsxv3.common.synchronization [req-978f7fa5-ce86-4c2c-b5ae-0b4219775816 req-1ed66daf-2530-4420-99b8-77dd6cd58c22 service nova] Enqueued Resource ID: 9e2402e4-d91c-4921-815e-0d5aabda4d53 with Priority: HIGHEST for action port [ 1006.796713] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f2518e8-b195-4520-b262-caa765ab7e27 with Priority: HIGHEST for action security_group_rules [ 1006.796713] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f2518e8-b195-4520-b262-caa765ab7e27 with Priority: HIGHEST for action security_group_members [ 1006.796713] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e2402e4-d91c-4921-815e-0d5aabda4d53 with Priority: HIGHEST for action port [ 1006.796820] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9f2518e8-b195-4520-b262-caa765ab7e27 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.796950] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9f2518e8-b195-4520-b262-caa765ab7e27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.797035] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9f2518e8-b195-4520-b262-caa765ab7e27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.799474] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9f2518e8-b195-4520-b262-caa765ab7e27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.799474] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9f2518e8-b195-4520-b262-caa765ab7e27',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.800886] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-9f2518e8-b195-4520-b262-caa765ab7e27 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.801053] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9f2518e8-b195-4520-b262-caa765ab7e27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.802516] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-9e2402e4-d91c-4921-815e-0d5aabda4d53 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.802516] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9e2402e4-d91c-4921-815e-0d5aabda4d53" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.802516] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9e2402e4-d91c-4921-815e-0d5aabda4d53" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.802516] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9e2402e4-d91c-4921-815e-0d5aabda4d53" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.802516] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9e2402e4-d91c-4921-815e-0d5aabda4d53',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1007.179884] env[69188]: INFO networking_nsxv3.common.synchronization [None req-db2785dc-fab0-4057-9572-661450fee87c None None] Enqueued Resource ID: 1a18da9c-4e83-4197-986c-0872153f85a3 with Priority: HIGHEST for action port [ 1007.180467] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1a18da9c-4e83-4197-986c-0872153f85a3 with Priority: HIGHEST for action port [ 1007.180814] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-1a18da9c-4e83-4197-986c-0872153f85a3 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.180938] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1a18da9c-4e83-4197-986c-0872153f85a3" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.181012] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1a18da9c-4e83-4197-986c-0872153f85a3" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.182869] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1a18da9c-4e83-4197-986c-0872153f85a3" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.182963] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1a18da9c-4e83-4197-986c-0872153f85a3',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1007.306210] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-9f2518e8-b195-4520-b262-caa765ab7e27 taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.306210] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9f2518e8-b195-4520-b262-caa765ab7e27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.306210] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9e2402e4-d91c-4921-815e-0d5aabda4d53 with status ACTIVE [ 1007.306210] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.306210] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.306210] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.306210] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.306210] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.306210] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.306210] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.306210] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.306210] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.306210] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.306210] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.306731] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.306731] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.306731] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.306731] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.306731] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9e2402e4-d91c-4921-815e-0d5aabda4d53 is going to be updated. [ 1007.330254] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.330410] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.330510] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.330753] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.330935] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.331154] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9e2402e4-d91c-4921-815e-0d5aabda4d53" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.743647] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1a18da9c-4e83-4197-986c-0872153f85a3 [ 1007.743647] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.743647] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.743647] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.743647] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.743647] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.743647] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1a18da9c-4e83-4197-986c-0872153f85a3 already deleted. [ 1007.743647] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1a18da9c-4e83-4197-986c-0872153f85a3" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.592915] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 048d5e2e-adfe-4bc0-9ae5-f6d99d633e62 in Status: SUCCESS [ 1008.593211] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-048d5e2e-adfe-4bc0-9ae5-f6d99d633e62" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.593359] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-048d5e2e-adfe-4bc0-9ae5-f6d99d633e62" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.593580] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-048d5e2e-adfe-4bc0-9ae5-f6d99d633e62" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.594051] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.594051] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.594051] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.594214] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.594291] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.594488] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-048d5e2e-adfe-4bc0-9ae5-f6d99d633e62" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.594590] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('048d5e2e-adfe-4bc0-9ae5-f6d99d633e62',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.752083] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9f2518e8-b195-4520-b262-caa765ab7e27 in Status: SUCCESS [ 1008.752364] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9f2518e8-b195-4520-b262-caa765ab7e27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.752555] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9f2518e8-b195-4520-b262-caa765ab7e27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.752791] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9f2518e8-b195-4520-b262-caa765ab7e27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.753013] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.753162] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.753235] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.753389] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.753467] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.753560] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9f2518e8-b195-4520-b262-caa765ab7e27',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.100748] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('048d5e2e-adfe-4bc0-9ae5-f6d99d633e62',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.257167] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9f2518e8-b195-4520-b262-caa765ab7e27',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.604637] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 048d5e2e-adfe-4bc0-9ae5-f6d99d633e62: rpc.has_security_group_logging(os_id): False [ 1009.625338] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.626292] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.626572] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.626619] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.626683] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.626957] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.627076] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.627140] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.627302] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.628032] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.628032] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 048d5e2e-adfe-4bc0-9ae5-f6d99d633e62 is going to be created. [ 1009.716815] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.716964] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.717059] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.717259] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.717463] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.731177] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 048d5e2e-adfe-4bc0-9ae5-f6d99d633e62 in Status: IN_PROGRESS for 2s [ 1009.758906] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9f2518e8-b195-4520-b262-caa765ab7e27',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1010.263448] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.263448] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.263448] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.263587] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.263587] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.263727] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9f2518e8-b195-4520-b262-caa765ab7e27 is going to be updated. [ 1010.292185] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.292321] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.292388] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.292594] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.292727] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.300454] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9f2518e8-b195-4520-b262-caa765ab7e27 in Status: IN_PROGRESS for 2s [ 1010.939664] env[69188]: INFO networking_nsxv3.common.synchronization [req-336fbbf0-0284-4ce4-9e73-7f2a390dca28 req-2580fd6f-9af9-40ba-9893-0e4e87e8af4e tempest-ImagesTestJSON-2034330654 tempest-ImagesTestJSON-2034330654-project-member] Enqueued Resource ID: 199db626-eef5-4a20-b92a-585841c1cff4 with Priority: HIGHEST for action security_group_members [ 1010.939664] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 199db626-eef5-4a20-b92a-585841c1cff4 with Priority: HIGHEST for action security_group_members [ 1010.939664] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-199db626-eef5-4a20-b92a-585841c1cff4 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.944137] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-199db626-eef5-4a20-b92a-585841c1cff4" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.944137] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-199db626-eef5-4a20-b92a-585841c1cff4" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.944137] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-199db626-eef5-4a20-b92a-585841c1cff4" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.944137] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.944137] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.944137] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.944137] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.944412] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.944412] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('199db626-eef5-4a20-b92a-585841c1cff4',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1011.089201] env[69188]: INFO networking_nsxv3.common.synchronization [None req-74f8496e-76ec-4ad1-afb7-72431e44d744 None None] Enqueued Resource ID: 6445bca9-7071-4d39-8831-60b4f215b269 with Priority: HIGHEST for action port [ 1011.089201] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6445bca9-7071-4d39-8831-60b4f215b269 with Priority: HIGHEST for action port [ 1011.089201] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-6445bca9-7071-4d39-8831-60b4f215b269 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.089201] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6445bca9-7071-4d39-8831-60b4f215b269" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.089201] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6445bca9-7071-4d39-8831-60b4f215b269" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.089201] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6445bca9-7071-4d39-8831-60b4f215b269" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.089201] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6445bca9-7071-4d39-8831-60b4f215b269',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1011.448125] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('199db626-eef5-4a20-b92a-585841c1cff4',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1011.593459] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6445bca9-7071-4d39-8831-60b4f215b269 [ 1011.593618] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.593943] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.593943] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.594093] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.594144] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.594243] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6445bca9-7071-4d39-8831-60b4f215b269 already deleted. [ 1011.594310] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6445bca9-7071-4d39-8831-60b4f215b269" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.759108] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 048d5e2e-adfe-4bc0-9ae5-f6d99d633e62 in Status: SUCCESS [ 1011.759108] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-048d5e2e-adfe-4bc0-9ae5-f6d99d633e62" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.948580] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('199db626-eef5-4a20-b92a-585841c1cff4',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.311270] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9f2518e8-b195-4520-b262-caa765ab7e27 in Status: SUCCESS [ 1012.311270] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9f2518e8-b195-4520-b262-caa765ab7e27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.311270] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9f2518e8-b195-4520-b262-caa765ab7e27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.311270] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9f2518e8-b195-4520-b262-caa765ab7e27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.311270] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.311270] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.311270] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.311637] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.311637] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.311637] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9f2518e8-b195-4520-b262-caa765ab7e27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.311637] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9f2518e8-b195-4520-b262-caa765ab7e27',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.446023] env[69188]: INFO networking_nsxv3.common.synchronization [None req-7d16c464-693f-4f8a-8f24-1cf6a7510b81 tempest-ServersTestManualDisk-291117102 tempest-ServersTestManualDisk-291117102-project-member] Enqueued Resource ID: 6551850f-c3f5-470f-b5eb-f7d542ab3a90 with Priority: HIGHEST for action security_group_rules [ 1012.446023] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6551850f-c3f5-470f-b5eb-f7d542ab3a90 with Priority: HIGHEST for action security_group_rules [ 1012.446023] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6551850f-c3f5-470f-b5eb-f7d542ab3a90 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.446023] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6551850f-c3f5-470f-b5eb-f7d542ab3a90" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.446023] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6551850f-c3f5-470f-b5eb-f7d542ab3a90" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.446023] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6551850f-c3f5-470f-b5eb-f7d542ab3a90" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.446722] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6551850f-c3f5-470f-b5eb-f7d542ab3a90',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.454835] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.454835] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.454835] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.454835] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.454835] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.454835] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 199db626-eef5-4a20-b92a-585841c1cff4 is going to be updated. [ 1012.486667] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.486667] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.486667] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.486667] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.486667] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.493293] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 199db626-eef5-4a20-b92a-585841c1cff4 in Status: IN_PROGRESS for 2s [ 1012.548408] env[69188]: INFO networking_nsxv3.common.synchronization [None req-b84ebd9f-e8cc-43c7-8891-ba72ba6a80b8 tempest-ServersTestManualDisk-291117102 tempest-ServersTestManualDisk-291117102-project-member] Enqueued Resource ID: 6551850f-c3f5-470f-b5eb-f7d542ab3a90 with Priority: HIGHEST for action security_group_rules [ 1012.548408] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6551850f-c3f5-470f-b5eb-f7d542ab3a90 with Priority: HIGHEST for action security_group_rules [ 1012.549334] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6551850f-c3f5-470f-b5eb-f7d542ab3a90 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.549653] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6551850f-c3f5-470f-b5eb-f7d542ab3a90" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.814130] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-9f2518e8-b195-4520-b262-caa765ab7e27 taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.815407] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9f2518e8-b195-4520-b262-caa765ab7e27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.815708] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9f2518e8-b195-4520-b262-caa765ab7e27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.815783] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9f2518e8-b195-4520-b262-caa765ab7e27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.815929] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.816047] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.816111] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.816270] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.816354] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.816440] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9f2518e8-b195-4520-b262-caa765ab7e27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.816598] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-9f2518e8-b195-4520-b262-caa765ab7e27 taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.816686] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9f2518e8-b195-4520-b262-caa765ab7e27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.816743] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9f2518e8-b195-4520-b262-caa765ab7e27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.816877] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9f2518e8-b195-4520-b262-caa765ab7e27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.817022] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.817686] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.817686] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.817686] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.817686] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.817686] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9f2518e8-b195-4520-b262-caa765ab7e27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.817686] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9f2518e8-b195-4520-b262-caa765ab7e27',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.860878] env[69188]: INFO networking_nsxv3.common.synchronization [None req-b23fccd1-ef49-4f47-9d9f-22327092f427 None None] Enqueued Resource ID: 2a37be98-115f-4903-bddb-4069e5694e1f with Priority: HIGHEST for action port [ 1012.861284] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2a37be98-115f-4903-bddb-4069e5694e1f with Priority: HIGHEST for action port [ 1012.861568] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-2a37be98-115f-4903-bddb-4069e5694e1f taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.861689] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2a37be98-115f-4903-bddb-4069e5694e1f" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.861752] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2a37be98-115f-4903-bddb-4069e5694e1f" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.862132] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2a37be98-115f-4903-bddb-4069e5694e1f" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.862237] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2a37be98-115f-4903-bddb-4069e5694e1f',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.968416] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.968824] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.968824] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.969053] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.969265] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.969415] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6551850f-c3f5-470f-b5eb-f7d542ab3a90 already deleted. [ 1012.969551] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6551850f-c3f5-470f-b5eb-f7d542ab3a90" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.969783] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6551850f-c3f5-470f-b5eb-f7d542ab3a90" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.970188] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6551850f-c3f5-470f-b5eb-f7d542ab3a90" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.970395] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6551850f-c3f5-470f-b5eb-f7d542ab3a90',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1013.322317] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9f2518e8-b195-4520-b262-caa765ab7e27: rpc.has_security_group_logging(os_id): False [ 1013.339559] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.339741] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.339809] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.340050] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.356666] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.356981] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.357132] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.357210] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.357414] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.357505] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.357680] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.357773] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.357819] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.357961] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.358039] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.359024] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.359024] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.359024] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.359024] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.359024] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.359024] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9f2518e8-b195-4520-b262-caa765ab7e27 is going to be updated. [ 1013.366215] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2a37be98-115f-4903-bddb-4069e5694e1f [ 1013.367224] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.367224] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.367224] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.367224] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.367224] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.367224] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2a37be98-115f-4903-bddb-4069e5694e1f already deleted. [ 1013.367224] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2a37be98-115f-4903-bddb-4069e5694e1f" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.414373] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.418436] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.418436] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.418436] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.418436] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.426494] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9f2518e8-b195-4520-b262-caa765ab7e27 in Status: IN_PROGRESS for 2s [ 1013.491026] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.491026] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.491026] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.491026] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.491026] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.491026] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6551850f-c3f5-470f-b5eb-f7d542ab3a90 already deleted. [ 1013.491026] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6551850f-c3f5-470f-b5eb-f7d542ab3a90" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.502819] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 199db626-eef5-4a20-b92a-585841c1cff4 in Status: SUCCESS [ 1014.503134] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-199db626-eef5-4a20-b92a-585841c1cff4" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.439812] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9f2518e8-b195-4520-b262-caa765ab7e27 in Status: SUCCESS [ 1015.439812] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9f2518e8-b195-4520-b262-caa765ab7e27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.863071] env[69188]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1017.863375] env[69188]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1017.896544] env[69188]: INFO networking_nsxv3.common.synchronization [req-10db8b90-9d96-4c7f-9dda-cec6446fe676 req-87029954-8a07-4fb5-a99b-a3675b738d71 tempest-ServerDiskConfigTestJSON-1476779099 tempest-ServerDiskConfigTestJSON-1476779099-project-member] Enqueued Resource ID: 24a7b083-b432-46d6-94de-76adf6ce22b3 with Priority: HIGHEST for action security_group_members [ 1017.897103] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 24a7b083-b432-46d6-94de-76adf6ce22b3 with Priority: HIGHEST for action security_group_members [ 1017.897474] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-24a7b083-b432-46d6-94de-76adf6ce22b3 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.897548] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-24a7b083-b432-46d6-94de-76adf6ce22b3" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.897616] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-24a7b083-b432-46d6-94de-76adf6ce22b3" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.897826] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-24a7b083-b432-46d6-94de-76adf6ce22b3" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.897976] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.898091] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.898151] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.898296] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.898380] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.898471] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('24a7b083-b432-46d6-94de-76adf6ce22b3',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1018.162700] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock network-907 taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.162914] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "network-907" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.163056] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "network-907" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.163332] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "network-907" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.163601] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.163762] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.163879] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.164119] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.164270] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.164484] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1018.164598] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] NeedRegenerationException {{(pid=69188) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1018.164708] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] no value, waiting for create lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1018.164816] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] value creation lock acquired {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1018.164925] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1018.165087] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Calling creation function for not-yet-present value {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1018.165171] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1018.183983] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1018.184222] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69188) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1018.184412] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Released creation lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1018.184665] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "network-907" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.184966] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock port-efcf04ff-0738-4455-a9c0-8ae80b00d3bb taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.185149] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "port-efcf04ff-0738-4455-a9c0-8ae80b00d3bb" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.185334] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "port-efcf04ff-0738-4455-a9c0-8ae80b00d3bb" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.185571] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "port-efcf04ff-0738-4455-a9c0-8ae80b00d3bb" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.185712] env[69188]: DEBUG networking_nsxv3.api.rpc [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('efcf04ff-0738-4455-a9c0-8ae80b00d3bb',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1018.401143] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.401352] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.401437] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.401733] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.401832] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.402046] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.402145] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.402213] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.402351] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.402428] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.402514] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 24a7b083-b432-46d6-94de-76adf6ce22b3 is going to be updated. [ 1018.428047] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.428197] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.428263] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.428459] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.428590] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.435980] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 24a7b083-b432-46d6-94de-76adf6ce22b3 in Status: IN_PROGRESS for 2s [ 1018.688876] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.689110] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.689351] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.689663] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.689820] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.689978] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Segment Port efcf04ff-0738-4455-a9c0-8ae80b00d3bb not found, creating... [ 1018.690322] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.690469] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.690591] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.690814] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.690959] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.691270] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.691431] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.691553] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.691767] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.691905] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.692059] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Resource: SegmentPort with ID: efcf04ff-0738-4455-a9c0-8ae80b00d3bb is going to be created. [ 1018.710373] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.710637] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.710769] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.711037] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.711272] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.711499] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "port-efcf04ff-0738-4455-a9c0-8ae80b00d3bb" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.988510] env[69188]: INFO networking_nsxv3.common.synchronization [req-4678ffb2-2140-41ca-869f-a1f368184c25 req-db95f900-b2bc-4076-8a5f-12fdf566023a tempest-ServerActionsTestJSON-1027345226 tempest-ServerActionsTestJSON-1027345226-project-member] Enqueued Resource ID: 725df672-6688-4714-8676-49fbb42ed7bd with Priority: HIGHEST for action security_group_members [ 1018.988864] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 725df672-6688-4714-8676-49fbb42ed7bd with Priority: HIGHEST for action security_group_members [ 1018.989177] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-725df672-6688-4714-8676-49fbb42ed7bd taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.990025] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-725df672-6688-4714-8676-49fbb42ed7bd" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.990025] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-725df672-6688-4714-8676-49fbb42ed7bd" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.990025] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-725df672-6688-4714-8676-49fbb42ed7bd" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.990025] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.990025] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.990025] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.990903] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.990903] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.990903] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('725df672-6688-4714-8676-49fbb42ed7bd',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.430665] env[69188]: INFO networking_nsxv3.common.synchronization [req-10db8b90-9d96-4c7f-9dda-cec6446fe676 req-fb6922e5-a63b-4a00-91e5-c28462881a67 service nova] Enqueued Resource ID: 24a7b083-b432-46d6-94de-76adf6ce22b3 with Priority: HIGHEST for action security_group_rules [ 1019.430856] env[69188]: INFO networking_nsxv3.common.synchronization [req-10db8b90-9d96-4c7f-9dda-cec6446fe676 req-fb6922e5-a63b-4a00-91e5-c28462881a67 service nova] Enqueued Resource ID: 24a7b083-b432-46d6-94de-76adf6ce22b3 with Priority: HIGHEST for action security_group_members [ 1019.431011] env[69188]: INFO networking_nsxv3.common.synchronization [req-10db8b90-9d96-4c7f-9dda-cec6446fe676 req-fb6922e5-a63b-4a00-91e5-c28462881a67 service nova] Enqueued Resource ID: efcf04ff-0738-4455-a9c0-8ae80b00d3bb with Priority: HIGHEST for action port [ 1019.431571] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 24a7b083-b432-46d6-94de-76adf6ce22b3 with Priority: HIGHEST for action security_group_rules [ 1019.431674] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 24a7b083-b432-46d6-94de-76adf6ce22b3 with Priority: HIGHEST for action security_group_members [ 1019.431785] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: efcf04ff-0738-4455-a9c0-8ae80b00d3bb with Priority: HIGHEST for action port [ 1019.433122] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-24a7b083-b432-46d6-94de-76adf6ce22b3 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.433286] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-24a7b083-b432-46d6-94de-76adf6ce22b3" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.433360] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-24a7b083-b432-46d6-94de-76adf6ce22b3" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.433573] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-24a7b083-b432-46d6-94de-76adf6ce22b3" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.433658] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('24a7b083-b432-46d6-94de-76adf6ce22b3',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.434875] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-24a7b083-b432-46d6-94de-76adf6ce22b3 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.434978] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-24a7b083-b432-46d6-94de-76adf6ce22b3" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.435227] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-efcf04ff-0738-4455-a9c0-8ae80b00d3bb taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.435313] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-efcf04ff-0738-4455-a9c0-8ae80b00d3bb" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.435352] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-efcf04ff-0738-4455-a9c0-8ae80b00d3bb" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.435764] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-efcf04ff-0738-4455-a9c0-8ae80b00d3bb" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.435764] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('efcf04ff-0738-4455-a9c0-8ae80b00d3bb',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.492888] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.493108] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.493108] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.493313] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.512940] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.513201] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.513313] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.513379] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.513566] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.513644] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.513733] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 725df672-6688-4714-8676-49fbb42ed7bd is going to be updated. [ 1019.536855] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.537034] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.537083] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.537292] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.537431] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.544608] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 725df672-6688-4714-8676-49fbb42ed7bd in Status: IN_PROGRESS for 2s [ 1019.938092] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-24a7b083-b432-46d6-94de-76adf6ce22b3 taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.938092] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-24a7b083-b432-46d6-94de-76adf6ce22b3" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.938092] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port efcf04ff-0738-4455-a9c0-8ae80b00d3bb with status ACTIVE [ 1019.938280] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.938387] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.938454] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.938657] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.938744] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.938911] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.939016] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.939072] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.939301] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.939397] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.939560] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.939691] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.939732] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.939843] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.939915] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.939999] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: efcf04ff-0738-4455-a9c0-8ae80b00d3bb is going to be updated. [ 1019.960401] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.960556] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.960616] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.960817] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.960952] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.961122] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-efcf04ff-0738-4455-a9c0-8ae80b00d3bb" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.226067] env[69188]: INFO networking_nsxv3.common.synchronization [req-54af25db-6783-4fee-8888-2d23d8570e5d req-b4d70a97-2363-4c8b-84eb-909cebd765fc tempest-ServerRescueNegativeTestJSON-1937748911 tempest-ServerRescueNegativeTestJSON-1937748911-project-member] Enqueued Resource ID: e3296f55-96ac-44eb-a498-8c6ab147c5ab with Priority: HIGHEST for action security_group_members [ 1020.226067] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e3296f55-96ac-44eb-a498-8c6ab147c5ab with Priority: HIGHEST for action security_group_members [ 1020.226363] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-e3296f55-96ac-44eb-a498-8c6ab147c5ab taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.226363] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e3296f55-96ac-44eb-a498-8c6ab147c5ab" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.226363] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e3296f55-96ac-44eb-a498-8c6ab147c5ab" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.226664] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e3296f55-96ac-44eb-a498-8c6ab147c5ab" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.226838] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.226941] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.227011] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.227251] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.227357] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.227454] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e3296f55-96ac-44eb-a498-8c6ab147c5ab',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.445603] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 24a7b083-b432-46d6-94de-76adf6ce22b3 in Status: SUCCESS [ 1020.445969] env[69188]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 24a7b083-b432-46d6-94de-76adf6ce22b3 deletion is rescheduled due to dependency. [ 1020.445969] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-24a7b083-b432-46d6-94de-76adf6ce22b3" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.446446] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-24a7b083-b432-46d6-94de-76adf6ce22b3" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.446446] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-24a7b083-b432-46d6-94de-76adf6ce22b3" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.446670] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.446670] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.446670] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.447806] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.447806] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.447806] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('24a7b083-b432-46d6-94de-76adf6ce22b3',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.549409] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock network-578 taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.549668] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "network-578" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.549750] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "network-578" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.550019] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "network-578" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.550281] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.550441] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.550562] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.550778] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.550926] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.551164] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1020.551752] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] NeedRegenerationException {{(pid=69188) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1020.551752] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] no value, waiting for create lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1020.551752] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] value creation lock acquired {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1020.551752] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1020.551752] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Calling creation function for not-yet-present value {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1020.551953] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1020.570972] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1020.571109] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69188) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1020.571252] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Released creation lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1020.571427] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "network-578" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.571717] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock port-e4f6543e-0988-4a21-be39-7e11b5c97479 taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.571882] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "port-e4f6543e-0988-4a21-be39-7e11b5c97479" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.572016] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "port-e4f6543e-0988-4a21-be39-7e11b5c97479" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.572335] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "port-e4f6543e-0988-4a21-be39-7e11b5c97479" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.572478] env[69188]: DEBUG networking_nsxv3.api.rpc [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e4f6543e-0988-4a21-be39-7e11b5c97479',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.730214] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.730431] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.730487] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.730697] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.730787] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.730981] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.731088] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.731150] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.731297] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.731374] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.731459] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e3296f55-96ac-44eb-a498-8c6ab147c5ab already deleted. [ 1020.731567] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e3296f55-96ac-44eb-a498-8c6ab147c5ab" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.949566] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('24a7b083-b432-46d6-94de-76adf6ce22b3',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.078088] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.078088] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.078088] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.078088] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.078088] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.078088] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Segment Port e4f6543e-0988-4a21-be39-7e11b5c97479 not found, creating... [ 1021.078088] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.078088] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.078088] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.078088] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.078088] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.078547] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.078547] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.078547] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.078547] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.078547] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.079160] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Resource: SegmentPort with ID: e4f6543e-0988-4a21-be39-7e11b5c97479 is going to be created. [ 1021.100119] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.100119] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.100119] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.100119] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.100119] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.100119] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "port-e4f6543e-0988-4a21-be39-7e11b5c97479" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.452553] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('24a7b083-b432-46d6-94de-76adf6ce22b3',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.554055] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 725df672-6688-4714-8676-49fbb42ed7bd in Status: SUCCESS [ 1021.554220] env[69188]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 725df672-6688-4714-8676-49fbb42ed7bd deletion is rescheduled due to dependency. [ 1021.554320] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-725df672-6688-4714-8676-49fbb42ed7bd" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.815113] env[69188]: INFO networking_nsxv3.common.synchronization [req-54af25db-6783-4fee-8888-2d23d8570e5d req-3ef64ed6-e01e-4c23-8ec5-cc3587d190d1 service nova] Enqueued Resource ID: e3296f55-96ac-44eb-a498-8c6ab147c5ab with Priority: HIGHEST for action security_group_rules [ 1021.815218] env[69188]: INFO networking_nsxv3.common.synchronization [req-54af25db-6783-4fee-8888-2d23d8570e5d req-3ef64ed6-e01e-4c23-8ec5-cc3587d190d1 service nova] Enqueued Resource ID: e3296f55-96ac-44eb-a498-8c6ab147c5ab with Priority: HIGHEST for action security_group_members [ 1021.815653] env[69188]: INFO networking_nsxv3.common.synchronization [req-54af25db-6783-4fee-8888-2d23d8570e5d req-3ef64ed6-e01e-4c23-8ec5-cc3587d190d1 service nova] Enqueued Resource ID: e4f6543e-0988-4a21-be39-7e11b5c97479 with Priority: HIGHEST for action port [ 1021.815653] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e3296f55-96ac-44eb-a498-8c6ab147c5ab with Priority: HIGHEST for action security_group_rules [ 1021.815653] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e3296f55-96ac-44eb-a498-8c6ab147c5ab with Priority: HIGHEST for action security_group_members [ 1021.815804] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e4f6543e-0988-4a21-be39-7e11b5c97479 with Priority: HIGHEST for action port [ 1021.816788] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e3296f55-96ac-44eb-a498-8c6ab147c5ab taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.816863] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e3296f55-96ac-44eb-a498-8c6ab147c5ab" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.816960] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e3296f55-96ac-44eb-a498-8c6ab147c5ab" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.817131] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e3296f55-96ac-44eb-a498-8c6ab147c5ab" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.817217] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e3296f55-96ac-44eb-a498-8c6ab147c5ab',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.818074] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-e3296f55-96ac-44eb-a498-8c6ab147c5ab taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.818521] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e3296f55-96ac-44eb-a498-8c6ab147c5ab" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.818615] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e3296f55-96ac-44eb-a498-8c6ab147c5ab" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.818789] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e3296f55-96ac-44eb-a498-8c6ab147c5ab" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.818942] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.819055] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.819112] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.819393] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.819483] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.819576] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e3296f55-96ac-44eb-a498-8c6ab147c5ab',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.821226] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-e4f6543e-0988-4a21-be39-7e11b5c97479 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.821349] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e4f6543e-0988-4a21-be39-7e11b5c97479" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.821459] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e4f6543e-0988-4a21-be39-7e11b5c97479" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.822930] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e4f6543e-0988-4a21-be39-7e11b5c97479" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.822930] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e4f6543e-0988-4a21-be39-7e11b5c97479',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.955343] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.955951] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.955951] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.955951] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.955951] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.956188] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 24a7b083-b432-46d6-94de-76adf6ce22b3 is going to be updated. [ 1021.981013] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.981175] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.981245] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.981673] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.981864] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.989756] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 24a7b083-b432-46d6-94de-76adf6ce22b3 in Status: IN_PROGRESS for 2s [ 1022.322375] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e3296f55-96ac-44eb-a498-8c6ab147c5ab',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.323438] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-e3296f55-96ac-44eb-a498-8c6ab147c5ab taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.323565] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e3296f55-96ac-44eb-a498-8c6ab147c5ab" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.324330] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e4f6543e-0988-4a21-be39-7e11b5c97479 with status ACTIVE [ 1022.324634] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.324634] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.324634] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.325048] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.325048] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.325048] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.325161] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.325161] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.325311] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.325387] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.325563] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.325698] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.325698] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.325883] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.325936] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.325983] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e4f6543e-0988-4a21-be39-7e11b5c97479 is going to be updated. [ 1022.346999] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.347217] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.347217] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.347427] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.347556] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.347701] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e4f6543e-0988-4a21-be39-7e11b5c97479" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.824550] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e3296f55-96ac-44eb-a498-8c6ab147c5ab',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.327305] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.327490] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.327575] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.327806] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.327901] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.328016] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e3296f55-96ac-44eb-a498-8c6ab147c5ab is going to be created. [ 1023.354034] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.354172] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.354247] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.354451] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.354605] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.365061] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e3296f55-96ac-44eb-a498-8c6ab147c5ab in Status: UNINITIALIZED for 2s [ 1023.998755] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 24a7b083-b432-46d6-94de-76adf6ce22b3 in Status: SUCCESS [ 1023.999046] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-24a7b083-b432-46d6-94de-76adf6ce22b3" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.999161] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-24a7b083-b432-46d6-94de-76adf6ce22b3" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.999435] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-24a7b083-b432-46d6-94de-76adf6ce22b3" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.999636] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.999769] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.999831] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.999983] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.000075] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.000159] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-24a7b083-b432-46d6-94de-76adf6ce22b3" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.000261] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('24a7b083-b432-46d6-94de-76adf6ce22b3',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.505577] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-24a7b083-b432-46d6-94de-76adf6ce22b3 taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.505577] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-24a7b083-b432-46d6-94de-76adf6ce22b3" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.505577] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-24a7b083-b432-46d6-94de-76adf6ce22b3" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.505779] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-24a7b083-b432-46d6-94de-76adf6ce22b3" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.506390] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.506524] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.506620] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.506795] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.506886] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.506976] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-24a7b083-b432-46d6-94de-76adf6ce22b3" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.507173] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-24a7b083-b432-46d6-94de-76adf6ce22b3 taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.507274] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-24a7b083-b432-46d6-94de-76adf6ce22b3" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.507345] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-24a7b083-b432-46d6-94de-76adf6ce22b3" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.507477] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-24a7b083-b432-46d6-94de-76adf6ce22b3" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.507616] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.507706] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.507763] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.507900] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.507977] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.508215] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-24a7b083-b432-46d6-94de-76adf6ce22b3" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.508338] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('24a7b083-b432-46d6-94de-76adf6ce22b3',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1025.011861] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 24a7b083-b432-46d6-94de-76adf6ce22b3: rpc.has_security_group_logging(os_id): False [ 1025.028770] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.028918] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.028989] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.029215] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.029366] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.029571] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.030238] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.030350] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.030526] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.030610] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.030839] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.030937] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.031006] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.031154] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.031229] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.031409] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.031502] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.031617] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.031776] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.031853] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.031938] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 24a7b083-b432-46d6-94de-76adf6ce22b3 is going to be updated. [ 1025.096948] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.097119] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.097192] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.097422] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.097562] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.109627] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 24a7b083-b432-46d6-94de-76adf6ce22b3 in Status: IN_PROGRESS for 2s [ 1025.373936] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e3296f55-96ac-44eb-a498-8c6ab147c5ab in Status: SUCCESS [ 1025.374219] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e3296f55-96ac-44eb-a498-8c6ab147c5ab" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.374429] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e3296f55-96ac-44eb-a498-8c6ab147c5ab" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.374692] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e3296f55-96ac-44eb-a498-8c6ab147c5ab" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.374907] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.375077] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.375164] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.375347] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.375434] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.375563] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e3296f55-96ac-44eb-a498-8c6ab147c5ab" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.375675] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e3296f55-96ac-44eb-a498-8c6ab147c5ab',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1025.879278] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e3296f55-96ac-44eb-a498-8c6ab147c5ab',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1026.045065] env[69188]: INFO networking_nsxv3.common.synchronization [req-e0a1cd52-1d46-4add-a0d8-8395fa6d1409 req-ab47f00b-41a7-416e-aede-804431599555 tempest-ServersAdminTestJSON-1988649207 tempest-ServersAdminTestJSON-1988649207-project-member] Enqueued Resource ID: 5e76d42e-7ec6-4a5e-aa9c-c5a285d62318 with Priority: HIGHEST for action security_group_members [ 1026.046264] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e76d42e-7ec6-4a5e-aa9c-c5a285d62318 with Priority: HIGHEST for action security_group_members [ 1026.046264] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e76d42e-7ec6-4a5e-aa9c-c5a285d62318 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.046264] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e76d42e-7ec6-4a5e-aa9c-c5a285d62318" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.046264] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e76d42e-7ec6-4a5e-aa9c-c5a285d62318" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.046476] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e76d42e-7ec6-4a5e-aa9c-c5a285d62318" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.046476] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.046557] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.046598] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.046733] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.046815] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.047423] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5e76d42e-7ec6-4a5e-aa9c-c5a285d62318',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1026.383013] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e3296f55-96ac-44eb-a498-8c6ab147c5ab: rpc.has_security_group_logging(os_id): False [ 1026.401052] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.401200] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.401266] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.401469] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.401619] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.401873] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.401972] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.402142] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.402193] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.402266] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.402351] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e3296f55-96ac-44eb-a498-8c6ab147c5ab is going to be created. [ 1026.466336] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.466553] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.466553] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.466753] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.466940] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.476436] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e3296f55-96ac-44eb-a498-8c6ab147c5ab in Status: IN_PROGRESS for 2s [ 1026.551885] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.552039] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.552110] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.552321] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.588414] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.588728] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.588805] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.588853] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.589072] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.589170] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.589296] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5e76d42e-7ec6-4a5e-aa9c-c5a285d62318 is going to be updated. [ 1026.614845] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.614975] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.615062] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.615263] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.615405] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.623472] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5e76d42e-7ec6-4a5e-aa9c-c5a285d62318 in Status: IN_PROGRESS for 2s [ 1027.125221] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 24a7b083-b432-46d6-94de-76adf6ce22b3 in Status: SUCCESS [ 1027.125514] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-24a7b083-b432-46d6-94de-76adf6ce22b3" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.489787] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e3296f55-96ac-44eb-a498-8c6ab147c5ab in Status: SUCCESS [ 1028.490090] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e3296f55-96ac-44eb-a498-8c6ab147c5ab" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.632760] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5e76d42e-7ec6-4a5e-aa9c-c5a285d62318 in Status: SUCCESS [ 1028.633057] env[69188]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5e76d42e-7ec6-4a5e-aa9c-c5a285d62318 deletion is rescheduled due to dependency. [ 1028.633190] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e76d42e-7ec6-4a5e-aa9c-c5a285d62318" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.911368] env[69188]: INFO networking_nsxv3.common.synchronization [req-13510859-d6b7-41e5-ad31-df43bb71489e req-af5de3f2-dfc5-468c-884f-af33a3f37391 tempest-ServersNegativeTestJSON-5747953 tempest-ServersNegativeTestJSON-5747953-project-member] Enqueued Resource ID: 938f39e5-b2c4-4a5d-b8ea-03c277953ec9 with Priority: HIGHEST for action security_group_members [ 1028.911711] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 938f39e5-b2c4-4a5d-b8ea-03c277953ec9 with Priority: HIGHEST for action security_group_members [ 1028.912031] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-938f39e5-b2c4-4a5d-b8ea-03c277953ec9 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.912194] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-938f39e5-b2c4-4a5d-b8ea-03c277953ec9" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.912284] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-938f39e5-b2c4-4a5d-b8ea-03c277953ec9" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.912501] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-938f39e5-b2c4-4a5d-b8ea-03c277953ec9" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.912664] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.912792] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.912857] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.912975] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.913069] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.913162] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('938f39e5-b2c4-4a5d-b8ea-03c277953ec9',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.278310] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock network-22 taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.278715] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "network-22" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.278715] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "network-22" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.278973] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "network-22" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.279275] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.279452] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.279576] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.280831] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.280831] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.280831] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1029.280831] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] NeedRegenerationException {{(pid=69188) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1029.280831] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] no value, waiting for create lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1029.280831] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] value creation lock acquired {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1029.280831] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1029.280831] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Calling creation function for not-yet-present value {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1029.281374] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1029.308493] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1029.308775] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=69188) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1029.309131] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Released creation lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1029.309322] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "network-22" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.310057] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock port-995ce199-c506-47a3-8d98-a86b919ece91 taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.310057] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "port-995ce199-c506-47a3-8d98-a86b919ece91" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.310234] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "port-995ce199-c506-47a3-8d98-a86b919ece91" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.310443] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "port-995ce199-c506-47a3-8d98-a86b919ece91" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.310613] env[69188]: DEBUG networking_nsxv3.api.rpc [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('995ce199-c506-47a3-8d98-a86b919ece91',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.416009] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.416188] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.416261] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.416483] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.416575] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.416785] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.416880] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.416951] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.417102] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.417181] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.417266] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 938f39e5-b2c4-4a5d-b8ea-03c277953ec9 already deleted. [ 1029.417517] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-938f39e5-b2c4-4a5d-b8ea-03c277953ec9" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.816563] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.816563] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.816563] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.816974] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.816974] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.817083] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Segment Port 995ce199-c506-47a3-8d98-a86b919ece91 not found, creating... [ 1029.817405] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.817611] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.821020] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.821020] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.821020] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.821020] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.821020] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.821020] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.821020] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.821020] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.821020] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Resource: SegmentPort with ID: 995ce199-c506-47a3-8d98-a86b919ece91 is going to be created. [ 1029.838926] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.838926] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.839081] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.840276] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.840276] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.840276] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "port-995ce199-c506-47a3-8d98-a86b919ece91" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.613986] env[69188]: INFO networking_nsxv3.common.synchronization [req-13510859-d6b7-41e5-ad31-df43bb71489e req-e00245a4-9681-4b75-aa20-4444dee48ce1 service nova] Enqueued Resource ID: 938f39e5-b2c4-4a5d-b8ea-03c277953ec9 with Priority: HIGHEST for action security_group_rules [ 1030.614377] env[69188]: INFO networking_nsxv3.common.synchronization [req-13510859-d6b7-41e5-ad31-df43bb71489e req-e00245a4-9681-4b75-aa20-4444dee48ce1 service nova] Enqueued Resource ID: 938f39e5-b2c4-4a5d-b8ea-03c277953ec9 with Priority: HIGHEST for action security_group_members [ 1030.614720] env[69188]: INFO networking_nsxv3.common.synchronization [req-13510859-d6b7-41e5-ad31-df43bb71489e req-e00245a4-9681-4b75-aa20-4444dee48ce1 service nova] Enqueued Resource ID: 995ce199-c506-47a3-8d98-a86b919ece91 with Priority: HIGHEST for action port [ 1030.616160] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 938f39e5-b2c4-4a5d-b8ea-03c277953ec9 with Priority: HIGHEST for action security_group_rules [ 1030.616160] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 938f39e5-b2c4-4a5d-b8ea-03c277953ec9 with Priority: HIGHEST for action security_group_members [ 1030.616160] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 995ce199-c506-47a3-8d98-a86b919ece91 with Priority: HIGHEST for action port [ 1030.616160] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-938f39e5-b2c4-4a5d-b8ea-03c277953ec9 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.616632] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-938f39e5-b2c4-4a5d-b8ea-03c277953ec9" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.616835] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-938f39e5-b2c4-4a5d-b8ea-03c277953ec9" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.617216] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-938f39e5-b2c4-4a5d-b8ea-03c277953ec9" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.620070] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('938f39e5-b2c4-4a5d-b8ea-03c277953ec9',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.620070] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-938f39e5-b2c4-4a5d-b8ea-03c277953ec9 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.620070] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-938f39e5-b2c4-4a5d-b8ea-03c277953ec9" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.620070] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-938f39e5-b2c4-4a5d-b8ea-03c277953ec9" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.620070] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-938f39e5-b2c4-4a5d-b8ea-03c277953ec9" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.620070] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.620070] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.620070] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.620070] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.620070] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.620070] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('938f39e5-b2c4-4a5d-b8ea-03c277953ec9',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.622728] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-995ce199-c506-47a3-8d98-a86b919ece91 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.623850] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-995ce199-c506-47a3-8d98-a86b919ece91" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.625570] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-995ce199-c506-47a3-8d98-a86b919ece91" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.625570] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-995ce199-c506-47a3-8d98-a86b919ece91" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.625570] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('995ce199-c506-47a3-8d98-a86b919ece91',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1031.125948] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('938f39e5-b2c4-4a5d-b8ea-03c277953ec9',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1031.128385] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-938f39e5-b2c4-4a5d-b8ea-03c277953ec9 taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.128496] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-938f39e5-b2c4-4a5d-b8ea-03c277953ec9" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.128682] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 995ce199-c506-47a3-8d98-a86b919ece91 with status ACTIVE [ 1031.128835] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.128941] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.129015] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.129238] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.133018] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.133018] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.133018] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.133018] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.133018] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.133018] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.133018] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.133018] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.133018] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.133018] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.133018] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.133018] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 995ce199-c506-47a3-8d98-a86b919ece91 is going to be updated. [ 1031.152546] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.152741] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.152817] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.153020] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.153153] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.153309] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-995ce199-c506-47a3-8d98-a86b919ece91" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.249361] env[69188]: INFO networking_nsxv3.common.synchronization [None req-753265d8-e3cb-47e8-afb4-db6e7d9700ba None None] Enqueued Resource ID: 87e38d51-3f6c-47e3-abe9-1b7070b3763c with Priority: HIGHEST for action port [ 1031.249800] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 87e38d51-3f6c-47e3-abe9-1b7070b3763c with Priority: HIGHEST for action port [ 1031.250162] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-87e38d51-3f6c-47e3-abe9-1b7070b3763c taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.250342] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-87e38d51-3f6c-47e3-abe9-1b7070b3763c" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.250458] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-87e38d51-3f6c-47e3-abe9-1b7070b3763c" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.250783] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-87e38d51-3f6c-47e3-abe9-1b7070b3763c" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.250988] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('87e38d51-3f6c-47e3-abe9-1b7070b3763c',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1031.459016] env[69188]: INFO networking_nsxv3.common.synchronization [req-1256bd20-077a-4e7d-8c48-d33bcf51e68a req-7659a7a5-47e1-423f-8b17-29da2dbf2090 tempest-ServersTestBootFromVolume-721515798 tempest-ServersTestBootFromVolume-721515798-project-member] Enqueued Resource ID: 5f183b9d-5066-4eee-a079-2adf3a1d0f7c with Priority: HIGHEST for action security_group_members [ 1031.459016] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5f183b9d-5066-4eee-a079-2adf3a1d0f7c with Priority: HIGHEST for action security_group_members [ 1031.459016] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-5f183b9d-5066-4eee-a079-2adf3a1d0f7c taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.459016] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5f183b9d-5066-4eee-a079-2adf3a1d0f7c" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.459016] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5f183b9d-5066-4eee-a079-2adf3a1d0f7c" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.459016] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5f183b9d-5066-4eee-a079-2adf3a1d0f7c" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.459016] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.459016] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.459016] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.459016] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.459016] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.459016] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5f183b9d-5066-4eee-a079-2adf3a1d0f7c',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1031.633509] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('938f39e5-b2c4-4a5d-b8ea-03c277953ec9',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1031.755867] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 87e38d51-3f6c-47e3-abe9-1b7070b3763c [ 1031.755867] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.755867] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.755867] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.756139] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.756314] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.756314] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:87e38d51-3f6c-47e3-abe9-1b7070b3763c already deleted. [ 1031.756535] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-87e38d51-3f6c-47e3-abe9-1b7070b3763c" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.960140] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock network-464 taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.960363] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "network-464" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.960489] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "network-464" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.960864] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "network-464" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.961137] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.961297] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.961420] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.961646] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.961813] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.962040] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1031.962163] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] NeedRegenerationException {{(pid=69188) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1031.962279] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] no value, waiting for create lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1031.962425] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] value creation lock acquired {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1031.962544] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1031.962741] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Calling creation function for not-yet-present value {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1031.962969] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1031.964683] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.964797] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.964894] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.965023] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.965108] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.966109] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.966109] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.966109] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.966109] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.966109] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.966109] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5f183b9d-5066-4eee-a079-2adf3a1d0f7c already deleted. [ 1031.966109] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5f183b9d-5066-4eee-a079-2adf3a1d0f7c" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.984019] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1031.984019] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69188) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1031.984019] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Released creation lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1031.984019] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "network-464" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.984019] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock port-3fc06607-15c8-49f4-88cf-04ff91400931 taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.984019] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "port-3fc06607-15c8-49f4-88cf-04ff91400931" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.984019] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "port-3fc06607-15c8-49f4-88cf-04ff91400931" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.984019] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "port-3fc06607-15c8-49f4-88cf-04ff91400931" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.984019] env[69188]: DEBUG networking_nsxv3.api.rpc [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3fc06607-15c8-49f4-88cf-04ff91400931',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.026031] env[69188]: INFO networking_nsxv3.common.synchronization [None req-ab9b2718-1e43-4bf6-97f0-30a93557d3f9 tempest-AttachVolumeShelveTestJSON-383073810 tempest-AttachVolumeShelveTestJSON-383073810-project-member] Enqueued Resource ID: 4c598260-71fe-43f5-ab89-63a95724ea23 with Priority: HIGHEST for action security_group_rules [ 1032.026031] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4c598260-71fe-43f5-ab89-63a95724ea23 with Priority: HIGHEST for action security_group_rules [ 1032.026031] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4c598260-71fe-43f5-ab89-63a95724ea23 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.026031] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4c598260-71fe-43f5-ab89-63a95724ea23" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.026031] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4c598260-71fe-43f5-ab89-63a95724ea23" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.026031] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4c598260-71fe-43f5-ab89-63a95724ea23" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.026031] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4c598260-71fe-43f5-ab89-63a95724ea23',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.138602] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.138922] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.138922] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.139113] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.139250] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.139430] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 938f39e5-b2c4-4a5d-b8ea-03c277953ec9 is going to be created. [ 1032.163434] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.163594] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.163690] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.163856] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.164030] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.167494] env[69188]: INFO networking_nsxv3.common.synchronization [None req-3b0b8401-09f3-4ab5-be4f-e586aabeeef0 tempest-AttachVolumeShelveTestJSON-383073810 tempest-AttachVolumeShelveTestJSON-383073810-project-member] Enqueued Resource ID: 4c598260-71fe-43f5-ab89-63a95724ea23 with Priority: HIGHEST for action security_group_rules [ 1032.167494] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4c598260-71fe-43f5-ab89-63a95724ea23 with Priority: HIGHEST for action security_group_rules [ 1032.167721] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4c598260-71fe-43f5-ab89-63a95724ea23 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.167797] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4c598260-71fe-43f5-ab89-63a95724ea23" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.174623] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 938f39e5-b2c4-4a5d-b8ea-03c277953ec9 in Status: UNINITIALIZED for 2s [ 1032.486362] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.486594] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.486728] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.487046] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.487216] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.487406] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Segment Port 3fc06607-15c8-49f4-88cf-04ff91400931 not found, creating... [ 1032.487701] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.487846] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.487969] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.488216] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.488362] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.488651] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.488877] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.488953] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.489156] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.489298] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.489610] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Resource: SegmentPort with ID: 3fc06607-15c8-49f4-88cf-04ff91400931 is going to be created. [ 1032.509814] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.510081] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.510313] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.511386] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.511386] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.511386] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "port-3fc06607-15c8-49f4-88cf-04ff91400931" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.549466] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.549466] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.549466] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.549466] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.549466] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.549466] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4c598260-71fe-43f5-ab89-63a95724ea23 already deleted. [ 1032.549980] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4c598260-71fe-43f5-ab89-63a95724ea23" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.550159] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4c598260-71fe-43f5-ab89-63a95724ea23" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.551222] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4c598260-71fe-43f5-ab89-63a95724ea23" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.551410] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4c598260-71fe-43f5-ab89-63a95724ea23',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.071012] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.071295] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.071367] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.071975] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.071975] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.071975] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4c598260-71fe-43f5-ab89-63a95724ea23 already deleted. [ 1033.071975] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4c598260-71fe-43f5-ab89-63a95724ea23" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.261140] env[69188]: INFO networking_nsxv3.common.synchronization [req-1256bd20-077a-4e7d-8c48-d33bcf51e68a req-8d9f1e3d-2c52-42c2-8a1a-cb1f03e6b353 service nova] Enqueued Resource ID: 5f183b9d-5066-4eee-a079-2adf3a1d0f7c with Priority: HIGHEST for action security_group_rules [ 1033.261399] env[69188]: INFO networking_nsxv3.common.synchronization [req-1256bd20-077a-4e7d-8c48-d33bcf51e68a req-8d9f1e3d-2c52-42c2-8a1a-cb1f03e6b353 service nova] Enqueued Resource ID: 5f183b9d-5066-4eee-a079-2adf3a1d0f7c with Priority: HIGHEST for action security_group_members [ 1033.261566] env[69188]: INFO networking_nsxv3.common.synchronization [req-1256bd20-077a-4e7d-8c48-d33bcf51e68a req-8d9f1e3d-2c52-42c2-8a1a-cb1f03e6b353 service nova] Enqueued Resource ID: 3fc06607-15c8-49f4-88cf-04ff91400931 with Priority: HIGHEST for action port [ 1033.261715] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5f183b9d-5066-4eee-a079-2adf3a1d0f7c with Priority: HIGHEST for action security_group_rules [ 1033.261842] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5f183b9d-5066-4eee-a079-2adf3a1d0f7c with Priority: HIGHEST for action security_group_members [ 1033.261937] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3fc06607-15c8-49f4-88cf-04ff91400931 with Priority: HIGHEST for action port [ 1033.262975] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5f183b9d-5066-4eee-a079-2adf3a1d0f7c taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.262975] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5f183b9d-5066-4eee-a079-2adf3a1d0f7c" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.262975] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5f183b9d-5066-4eee-a079-2adf3a1d0f7c" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.263344] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5f183b9d-5066-4eee-a079-2adf3a1d0f7c" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.264022] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5f183b9d-5066-4eee-a079-2adf3a1d0f7c',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.264288] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-5f183b9d-5066-4eee-a079-2adf3a1d0f7c taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.264396] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5f183b9d-5066-4eee-a079-2adf3a1d0f7c" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.264631] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5f183b9d-5066-4eee-a079-2adf3a1d0f7c" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.264631] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5f183b9d-5066-4eee-a079-2adf3a1d0f7c" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.264755] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.264841] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.266149] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.266149] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.266149] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.266149] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5f183b9d-5066-4eee-a079-2adf3a1d0f7c',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.266149] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-3fc06607-15c8-49f4-88cf-04ff91400931 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.266149] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3fc06607-15c8-49f4-88cf-04ff91400931" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.266149] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3fc06607-15c8-49f4-88cf-04ff91400931" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.266522] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3fc06607-15c8-49f4-88cf-04ff91400931" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.266522] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3fc06607-15c8-49f4-88cf-04ff91400931',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.465279] env[69188]: INFO networking_nsxv3.common.synchronization [None req-da915402-bbe5-4355-9622-0f4c4e684017 None None] Enqueued Resource ID: be4170bc-07bb-48f6-94a8-bb605cde2530 with Priority: HIGHEST for action port [ 1033.465279] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: be4170bc-07bb-48f6-94a8-bb605cde2530 with Priority: HIGHEST for action port [ 1033.465279] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-be4170bc-07bb-48f6-94a8-bb605cde2530 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.465279] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-be4170bc-07bb-48f6-94a8-bb605cde2530" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.465279] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-be4170bc-07bb-48f6-94a8-bb605cde2530" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.465279] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-be4170bc-07bb-48f6-94a8-bb605cde2530" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.465279] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('be4170bc-07bb-48f6-94a8-bb605cde2530',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.768585] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-5f183b9d-5066-4eee-a079-2adf3a1d0f7c taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.768785] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5f183b9d-5066-4eee-a079-2adf3a1d0f7c" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.768885] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5f183b9d-5066-4eee-a079-2adf3a1d0f7c',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.769833] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3fc06607-15c8-49f4-88cf-04ff91400931 with status ACTIVE [ 1033.770029] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.770176] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.770348] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.770590] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.770590] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.771158] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.771158] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.771158] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.771158] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.771369] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.771557] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.771646] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.771690] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.771889] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.772067] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.773196] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3fc06607-15c8-49f4-88cf-04ff91400931 is going to be updated. [ 1033.794775] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.794775] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.794775] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.794775] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.794775] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.794775] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3fc06607-15c8-49f4-88cf-04ff91400931" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.902856] env[69188]: INFO networking_nsxv3.common.synchronization [req-b5a6e127-4b40-4b12-b50f-1a83d3c3b71f req-8cfae2e0-5292-482f-9b1f-3617fb47e8e4 tempest-ListServersNegativeTestJSON-350712182 tempest-ListServersNegativeTestJSON-350712182-project-member] Enqueued Resource ID: bec5fbed-ec5a-4f98-90d3-ee0000b97d09 with Priority: HIGHEST for action security_group_members [ 1033.902856] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bec5fbed-ec5a-4f98-90d3-ee0000b97d09 with Priority: HIGHEST for action security_group_members [ 1033.903134] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-bec5fbed-ec5a-4f98-90d3-ee0000b97d09 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.904027] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bec5fbed-ec5a-4f98-90d3-ee0000b97d09" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.904027] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bec5fbed-ec5a-4f98-90d3-ee0000b97d09" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.904027] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bec5fbed-ec5a-4f98-90d3-ee0000b97d09" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.904027] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.904027] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.904027] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.904027] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.904442] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.904442] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bec5fbed-ec5a-4f98-90d3-ee0000b97d09',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.967021] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port be4170bc-07bb-48f6-94a8-bb605cde2530 [ 1033.967274] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.967415] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.967485] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.967693] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.967784] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.967881] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:be4170bc-07bb-48f6-94a8-bb605cde2530 already deleted. [ 1033.967960] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-be4170bc-07bb-48f6-94a8-bb605cde2530" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.184028] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 938f39e5-b2c4-4a5d-b8ea-03c277953ec9 in Status: SUCCESS [ 1034.184881] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-938f39e5-b2c4-4a5d-b8ea-03c277953ec9" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.184881] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-938f39e5-b2c4-4a5d-b8ea-03c277953ec9" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.184881] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-938f39e5-b2c4-4a5d-b8ea-03c277953ec9" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.184881] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.185361] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.185361] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.185361] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.185361] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.185361] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-938f39e5-b2c4-4a5d-b8ea-03c277953ec9" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.185361] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('938f39e5-b2c4-4a5d-b8ea-03c277953ec9',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1034.254162] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock network-513 taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.254652] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "network-513" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.254652] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "network-513" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.254797] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "network-513" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.255057] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.255215] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.255407] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.255668] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.256284] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.256284] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1034.256284] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] NeedRegenerationException {{(pid=69188) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1034.256284] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] no value, waiting for create lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1034.256519] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] value creation lock acquired {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1034.256519] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1034.256614] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Calling creation function for not-yet-present value {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1034.256669] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1034.280384] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1034.280384] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69188) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1034.280384] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Released creation lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1034.280384] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "network-513" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.280384] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock port-fca0944b-b951-4c83-8c59-0e9f9d063d7e taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.280384] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "port-fca0944b-b951-4c83-8c59-0e9f9d063d7e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.280384] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "port-fca0944b-b951-4c83-8c59-0e9f9d063d7e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.280384] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "port-fca0944b-b951-4c83-8c59-0e9f9d063d7e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.280384] env[69188]: DEBUG networking_nsxv3.api.rpc [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fca0944b-b951-4c83-8c59-0e9f9d063d7e',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1034.281031] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5f183b9d-5066-4eee-a079-2adf3a1d0f7c',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1034.408025] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.408025] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.408025] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.408025] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.408025] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.408025] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.408025] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.408025] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.408025] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.408025] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.408025] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bec5fbed-ec5a-4f98-90d3-ee0000b97d09 already deleted. [ 1034.408025] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bec5fbed-ec5a-4f98-90d3-ee0000b97d09" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.688641] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-938f39e5-b2c4-4a5d-b8ea-03c277953ec9 taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.688641] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-938f39e5-b2c4-4a5d-b8ea-03c277953ec9" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.688641] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-938f39e5-b2c4-4a5d-b8ea-03c277953ec9" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.688849] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-938f39e5-b2c4-4a5d-b8ea-03c277953ec9" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.688849] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.688944] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.688999] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.689153] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.689236] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.689321] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-938f39e5-b2c4-4a5d-b8ea-03c277953ec9" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.689543] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-938f39e5-b2c4-4a5d-b8ea-03c277953ec9 taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.689632] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-938f39e5-b2c4-4a5d-b8ea-03c277953ec9" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.689688] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-938f39e5-b2c4-4a5d-b8ea-03c277953ec9" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.689824] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-938f39e5-b2c4-4a5d-b8ea-03c277953ec9" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.690613] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.690613] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.690613] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.690613] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.690613] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.690613] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-938f39e5-b2c4-4a5d-b8ea-03c277953ec9" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.690613] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('938f39e5-b2c4-4a5d-b8ea-03c277953ec9',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1034.782555] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.782795] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.782952] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.783319] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.783509] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.783706] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Segment Port fca0944b-b951-4c83-8c59-0e9f9d063d7e not found, creating... [ 1034.784026] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.784240] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.784375] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.784654] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.784847] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.785203] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.785463] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.785647] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.785913] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.786110] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.786317] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Resource: SegmentPort with ID: fca0944b-b951-4c83-8c59-0e9f9d063d7e is going to be created. [ 1034.787681] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.787838] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.787917] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.788142] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.788236] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.788329] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5f183b9d-5066-4eee-a079-2adf3a1d0f7c is going to be created. [ 1034.810050] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.810386] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.810594] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.810886] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.811204] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.811462] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "port-fca0944b-b951-4c83-8c59-0e9f9d063d7e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.813483] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.813638] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.813638] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.813791] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.813942] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.822851] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5f183b9d-5066-4eee-a079-2adf3a1d0f7c in Status: UNINITIALIZED for 2s [ 1035.193327] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 938f39e5-b2c4-4a5d-b8ea-03c277953ec9: rpc.has_security_group_logging(os_id): False [ 1035.217032] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.217302] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.217302] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.217441] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.217544] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.217751] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.217853] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.217917] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.218168] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.218252] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.218447] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.218544] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.218608] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.218755] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.218834] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.219247] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.219376] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.219449] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.219604] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.219680] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.219769] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 938f39e5-b2c4-4a5d-b8ea-03c277953ec9 is going to be created. [ 1035.283113] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.283113] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.283113] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.283113] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.283113] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.293376] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 938f39e5-b2c4-4a5d-b8ea-03c277953ec9 in Status: IN_PROGRESS for 2s [ 1035.595660] env[69188]: INFO networking_nsxv3.common.synchronization [req-b5a6e127-4b40-4b12-b50f-1a83d3c3b71f req-be434598-ce02-432c-a1c3-fcad23dd4b01 service nova] Enqueued Resource ID: bec5fbed-ec5a-4f98-90d3-ee0000b97d09 with Priority: HIGHEST for action security_group_rules [ 1035.595660] env[69188]: INFO networking_nsxv3.common.synchronization [req-b5a6e127-4b40-4b12-b50f-1a83d3c3b71f req-be434598-ce02-432c-a1c3-fcad23dd4b01 service nova] Enqueued Resource ID: bec5fbed-ec5a-4f98-90d3-ee0000b97d09 with Priority: HIGHEST for action security_group_members [ 1035.595660] env[69188]: INFO networking_nsxv3.common.synchronization [req-b5a6e127-4b40-4b12-b50f-1a83d3c3b71f req-be434598-ce02-432c-a1c3-fcad23dd4b01 service nova] Enqueued Resource ID: fca0944b-b951-4c83-8c59-0e9f9d063d7e with Priority: HIGHEST for action port [ 1035.595889] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bec5fbed-ec5a-4f98-90d3-ee0000b97d09 with Priority: HIGHEST for action security_group_rules [ 1035.596264] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bec5fbed-ec5a-4f98-90d3-ee0000b97d09 with Priority: HIGHEST for action security_group_members [ 1035.596528] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fca0944b-b951-4c83-8c59-0e9f9d063d7e with Priority: HIGHEST for action port [ 1035.600028] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bec5fbed-ec5a-4f98-90d3-ee0000b97d09 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.600028] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bec5fbed-ec5a-4f98-90d3-ee0000b97d09" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.600028] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bec5fbed-ec5a-4f98-90d3-ee0000b97d09" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.600028] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bec5fbed-ec5a-4f98-90d3-ee0000b97d09" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.600028] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bec5fbed-ec5a-4f98-90d3-ee0000b97d09',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.600028] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-bec5fbed-ec5a-4f98-90d3-ee0000b97d09 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.600028] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bec5fbed-ec5a-4f98-90d3-ee0000b97d09" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.600028] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bec5fbed-ec5a-4f98-90d3-ee0000b97d09" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.600028] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bec5fbed-ec5a-4f98-90d3-ee0000b97d09" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.601296] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.602392] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.602392] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.602392] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.602392] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.602392] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bec5fbed-ec5a-4f98-90d3-ee0000b97d09',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.604487] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-fca0944b-b951-4c83-8c59-0e9f9d063d7e taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.604487] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fca0944b-b951-4c83-8c59-0e9f9d063d7e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.604487] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fca0944b-b951-4c83-8c59-0e9f9d063d7e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.604487] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fca0944b-b951-4c83-8c59-0e9f9d063d7e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.606019] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fca0944b-b951-4c83-8c59-0e9f9d063d7e',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1036.107335] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bec5fbed-ec5a-4f98-90d3-ee0000b97d09',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1036.108506] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-bec5fbed-ec5a-4f98-90d3-ee0000b97d09 taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.108599] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bec5fbed-ec5a-4f98-90d3-ee0000b97d09" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.108857] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fca0944b-b951-4c83-8c59-0e9f9d063d7e with status ACTIVE [ 1036.109050] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.109437] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.109437] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.109574] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.109574] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.110225] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.110225] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.110352] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.113922] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.113922] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.113922] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.113922] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.113922] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.113922] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.113922] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.113922] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fca0944b-b951-4c83-8c59-0e9f9d063d7e is going to be updated. [ 1036.131423] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.131423] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.131423] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.131663] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.131917] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.132045] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fca0944b-b951-4c83-8c59-0e9f9d063d7e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.617020] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bec5fbed-ec5a-4f98-90d3-ee0000b97d09',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1036.677658] env[69188]: INFO networking_nsxv3.common.synchronization [req-b5a6e127-4b40-4b12-b50f-1a83d3c3b71f req-1789816b-d286-4ca0-9d22-ac5ce38637d6 tempest-ListServersNegativeTestJSON-350712182 tempest-ListServersNegativeTestJSON-350712182-project-member] Enqueued Resource ID: bec5fbed-ec5a-4f98-90d3-ee0000b97d09 with Priority: HIGHEST for action security_group_members [ 1036.678223] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bec5fbed-ec5a-4f98-90d3-ee0000b97d09 with Priority: HIGHEST for action security_group_members [ 1036.678546] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-bec5fbed-ec5a-4f98-90d3-ee0000b97d09 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.678679] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bec5fbed-ec5a-4f98-90d3-ee0000b97d09" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.835598] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5f183b9d-5066-4eee-a079-2adf3a1d0f7c in Status: SUCCESS [ 1036.835884] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5f183b9d-5066-4eee-a079-2adf3a1d0f7c" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.836023] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5f183b9d-5066-4eee-a079-2adf3a1d0f7c" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.836294] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5f183b9d-5066-4eee-a079-2adf3a1d0f7c" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.836521] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.836663] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.836729] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.836904] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.837480] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.837480] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5f183b9d-5066-4eee-a079-2adf3a1d0f7c" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.837480] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5f183b9d-5066-4eee-a079-2adf3a1d0f7c',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1037.064266] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock network-513 taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.065016] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "network-513" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.065016] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "network-513" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.065016] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "network-513" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.065154] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.065285] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.065411] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.065628] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.065775] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.065985] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1037.066560] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] NeedRegenerationException {{(pid=69188) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1037.066560] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] no value, waiting for create lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1037.066560] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] value creation lock acquired {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1037.066560] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1037.066560] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Calling creation function for not-yet-present value {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1037.066731] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1037.086393] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1037.086601] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69188) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1037.086828] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Released creation lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1037.087064] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "network-513" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.087434] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock port-06726a61-d838-4eb6-b4b1-8010f9e6cb8a taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.087614] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "port-06726a61-d838-4eb6-b4b1-8010f9e6cb8a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.087785] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "port-06726a61-d838-4eb6-b4b1-8010f9e6cb8a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.088153] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "port-06726a61-d838-4eb6-b4b1-8010f9e6cb8a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.088313] env[69188]: DEBUG networking_nsxv3.api.rpc [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('06726a61-d838-4eb6-b4b1-8010f9e6cb8a',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1037.117024] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.117024] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.117024] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.117024] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.117024] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.117024] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bec5fbed-ec5a-4f98-90d3-ee0000b97d09 is going to be created. [ 1037.139611] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.139850] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.139906] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.140131] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.140294] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.151607] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bec5fbed-ec5a-4f98-90d3-ee0000b97d09 in Status: UNINITIALIZED for 2s [ 1037.307095] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 938f39e5-b2c4-4a5d-b8ea-03c277953ec9 in Status: SUCCESS [ 1037.307369] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-938f39e5-b2c4-4a5d-b8ea-03c277953ec9" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.343799] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5f183b9d-5066-4eee-a079-2adf3a1d0f7c',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1037.593254] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.593254] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.593254] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.593254] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.593254] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.593254] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Segment Port 06726a61-d838-4eb6-b4b1-8010f9e6cb8a not found, creating... [ 1037.593254] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.593254] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.593254] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.593675] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.593675] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.594533] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.594533] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.594533] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.594851] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.595071] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.595289] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Resource: SegmentPort with ID: 06726a61-d838-4eb6-b4b1-8010f9e6cb8a is going to be created. [ 1037.618034] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.618385] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.618417] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.618876] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.619190] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.619499] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "port-06726a61-d838-4eb6-b4b1-8010f9e6cb8a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.847678] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5f183b9d-5066-4eee-a079-2adf3a1d0f7c: rpc.has_security_group_logging(os_id): False [ 1037.867636] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.867853] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.867853] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.868144] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.868240] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.869043] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.869043] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.869043] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.869043] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.869043] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.869282] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5f183b9d-5066-4eee-a079-2adf3a1d0f7c is going to be created. [ 1037.939044] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.939212] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.939275] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.939565] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.939909] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.952650] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5f183b9d-5066-4eee-a079-2adf3a1d0f7c in Status: IN_PROGRESS for 2s [ 1038.330023] env[69188]: INFO networking_nsxv3.common.synchronization [req-b5a6e127-4b40-4b12-b50f-1a83d3c3b71f req-335724ed-d433-4f34-925f-f3c33ab4f900 service nova] Enqueued Resource ID: bec5fbed-ec5a-4f98-90d3-ee0000b97d09 with Priority: HIGHEST for action security_group_rules [ 1038.330023] env[69188]: INFO networking_nsxv3.common.synchronization [req-b5a6e127-4b40-4b12-b50f-1a83d3c3b71f req-335724ed-d433-4f34-925f-f3c33ab4f900 service nova] Enqueued Resource ID: bec5fbed-ec5a-4f98-90d3-ee0000b97d09 with Priority: HIGHEST for action security_group_members [ 1038.330023] env[69188]: INFO networking_nsxv3.common.synchronization [req-b5a6e127-4b40-4b12-b50f-1a83d3c3b71f req-335724ed-d433-4f34-925f-f3c33ab4f900 service nova] Enqueued Resource ID: 06726a61-d838-4eb6-b4b1-8010f9e6cb8a with Priority: HIGHEST for action port [ 1038.330023] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bec5fbed-ec5a-4f98-90d3-ee0000b97d09 with Priority: HIGHEST for action security_group_rules [ 1038.330023] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bec5fbed-ec5a-4f98-90d3-ee0000b97d09 with Priority: HIGHEST for action security_group_members [ 1038.330023] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06726a61-d838-4eb6-b4b1-8010f9e6cb8a with Priority: HIGHEST for action port [ 1038.330023] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bec5fbed-ec5a-4f98-90d3-ee0000b97d09 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.330023] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bec5fbed-ec5a-4f98-90d3-ee0000b97d09" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.330023] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-bec5fbed-ec5a-4f98-90d3-ee0000b97d09 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.330023] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bec5fbed-ec5a-4f98-90d3-ee0000b97d09" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.330535] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-06726a61-d838-4eb6-b4b1-8010f9e6cb8a taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.330535] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-06726a61-d838-4eb6-b4b1-8010f9e6cb8a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.330535] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-06726a61-d838-4eb6-b4b1-8010f9e6cb8a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.330535] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-06726a61-d838-4eb6-b4b1-8010f9e6cb8a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.330535] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('06726a61-d838-4eb6-b4b1-8010f9e6cb8a',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.832874] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 06726a61-d838-4eb6-b4b1-8010f9e6cb8a with status ACTIVE [ 1038.833218] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.833332] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.833407] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.833629] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.833723] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.833912] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.834013] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.834079] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.834236] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.834316] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.834504] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.834599] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.834662] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.834806] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.834882] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.835239] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 06726a61-d838-4eb6-b4b1-8010f9e6cb8a is going to be updated. [ 1038.858172] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.858329] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.858409] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.858619] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.861366] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.861579] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-06726a61-d838-4eb6-b4b1-8010f9e6cb8a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.152512] env[69188]: INFO networking_nsxv3.common.synchronization [req-b5a6e127-4b40-4b12-b50f-1a83d3c3b71f req-a49140a8-1456-4de5-bf2f-2451327ce049 tempest-ListServersNegativeTestJSON-350712182 tempest-ListServersNegativeTestJSON-350712182-project-member] Enqueued Resource ID: bec5fbed-ec5a-4f98-90d3-ee0000b97d09 with Priority: HIGHEST for action security_group_members [ 1039.154012] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bec5fbed-ec5a-4f98-90d3-ee0000b97d09 with Priority: HIGHEST for action security_group_members [ 1039.154368] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-bec5fbed-ec5a-4f98-90d3-ee0000b97d09 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.154477] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bec5fbed-ec5a-4f98-90d3-ee0000b97d09" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.162071] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bec5fbed-ec5a-4f98-90d3-ee0000b97d09 in Status: SUCCESS [ 1039.162344] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bec5fbed-ec5a-4f98-90d3-ee0000b97d09" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.162500] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bec5fbed-ec5a-4f98-90d3-ee0000b97d09" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.162730] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bec5fbed-ec5a-4f98-90d3-ee0000b97d09" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.162920] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.163049] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.163125] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.163262] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.163343] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.163426] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bec5fbed-ec5a-4f98-90d3-ee0000b97d09" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.163524] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('bec5fbed-ec5a-4f98-90d3-ee0000b97d09',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.164551] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bec5fbed-ec5a-4f98-90d3-ee0000b97d09" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.164551] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bec5fbed-ec5a-4f98-90d3-ee0000b97d09" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.168153] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.168153] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.168153] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.168153] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.168153] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.168153] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bec5fbed-ec5a-4f98-90d3-ee0000b97d09',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.584280] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock network-513 taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.584515] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "network-513" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.584618] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "network-513" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.584905] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "network-513" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.585181] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.585341] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.585466] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.585682] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.585866] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.586098] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1039.586220] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] NeedRegenerationException {{(pid=69188) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1039.586335] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] no value, waiting for create lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1039.586464] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] value creation lock acquired {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1039.586581] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1039.586692] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Calling creation function for not-yet-present value {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1039.586830] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1039.605618] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1039.605618] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69188) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1039.605802] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Released creation lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1039.605942] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "network-513" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.606300] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock port-3c15cedc-76d5-46e9-bf85-5bb96f4cf7b5 taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.606496] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "port-3c15cedc-76d5-46e9-bf85-5bb96f4cf7b5" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.606636] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "port-3c15cedc-76d5-46e9-bf85-5bb96f4cf7b5" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.606962] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "port-3c15cedc-76d5-46e9-bf85-5bb96f4cf7b5" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.607122] env[69188]: DEBUG networking_nsxv3.api.rpc [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3c15cedc-76d5-46e9-bf85-5bb96f4cf7b5',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.667302] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-bec5fbed-ec5a-4f98-90d3-ee0000b97d09 taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.667460] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bec5fbed-ec5a-4f98-90d3-ee0000b97d09" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.667688] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bec5fbed-ec5a-4f98-90d3-ee0000b97d09',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.963480] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5f183b9d-5066-4eee-a079-2adf3a1d0f7c in Status: SUCCESS [ 1039.963760] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5f183b9d-5066-4eee-a079-2adf3a1d0f7c" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.109439] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.109876] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.110053] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.110493] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.110730] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.111034] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Segment Port 3c15cedc-76d5-46e9-bf85-5bb96f4cf7b5 not found, creating... [ 1040.111522] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.111974] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.112149] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.112452] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.112685] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.113234] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.113433] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.113575] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.113889] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.114083] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.114271] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Resource: SegmentPort with ID: 3c15cedc-76d5-46e9-bf85-5bb96f4cf7b5 is going to be created. [ 1040.135119] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.135500] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.136336] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.136336] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.136538] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.138122] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "port-3c15cedc-76d5-46e9-bf85-5bb96f4cf7b5" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.171217] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bec5fbed-ec5a-4f98-90d3-ee0000b97d09',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1040.211395] env[69188]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-ca0141f8-e0d0-45bb-94d3-6579b85b932c None None] NSXv3 Agent Agent loop - iteration:1 completed [ 1040.211534] env[69188]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-ca0141f8-e0d0-45bb-94d3-6579b85b932c None None] NSXv3 Agent Agent loop - iteration:2 started [ 1040.673215] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.673215] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.673215] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.673496] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.673496] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.673691] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bec5fbed-ec5a-4f98-90d3-ee0000b97d09 is going to be updated. [ 1040.708958] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.709145] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.709198] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.709407] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.709562] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.718471] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bec5fbed-ec5a-4f98-90d3-ee0000b97d09 in Status: IN_PROGRESS for 2s [ 1040.879116] env[69188]: INFO networking_nsxv3.common.synchronization [req-b5a6e127-4b40-4b12-b50f-1a83d3c3b71f req-8a234582-9338-49bd-82bc-d6d549575683 service nova] Enqueued Resource ID: bec5fbed-ec5a-4f98-90d3-ee0000b97d09 with Priority: HIGHEST for action security_group_rules [ 1040.879424] env[69188]: INFO networking_nsxv3.common.synchronization [req-b5a6e127-4b40-4b12-b50f-1a83d3c3b71f req-8a234582-9338-49bd-82bc-d6d549575683 service nova] Enqueued Resource ID: bec5fbed-ec5a-4f98-90d3-ee0000b97d09 with Priority: HIGHEST for action security_group_members [ 1040.880024] env[69188]: INFO networking_nsxv3.common.synchronization [req-b5a6e127-4b40-4b12-b50f-1a83d3c3b71f req-8a234582-9338-49bd-82bc-d6d549575683 service nova] Enqueued Resource ID: 3c15cedc-76d5-46e9-bf85-5bb96f4cf7b5 with Priority: HIGHEST for action port [ 1040.880375] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bec5fbed-ec5a-4f98-90d3-ee0000b97d09 with Priority: HIGHEST for action security_group_rules [ 1040.880658] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bec5fbed-ec5a-4f98-90d3-ee0000b97d09 with Priority: HIGHEST for action security_group_members [ 1040.880729] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3c15cedc-76d5-46e9-bf85-5bb96f4cf7b5 with Priority: HIGHEST for action port [ 1040.881088] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bec5fbed-ec5a-4f98-90d3-ee0000b97d09 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.881322] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bec5fbed-ec5a-4f98-90d3-ee0000b97d09" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.881690] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-bec5fbed-ec5a-4f98-90d3-ee0000b97d09 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.884914] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bec5fbed-ec5a-4f98-90d3-ee0000b97d09" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.884914] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-3c15cedc-76d5-46e9-bf85-5bb96f4cf7b5 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.884914] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3c15cedc-76d5-46e9-bf85-5bb96f4cf7b5" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.884914] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3c15cedc-76d5-46e9-bf85-5bb96f4cf7b5" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.884914] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3c15cedc-76d5-46e9-bf85-5bb96f4cf7b5" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.884914] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3c15cedc-76d5-46e9-bf85-5bb96f4cf7b5',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.385506] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3c15cedc-76d5-46e9-bf85-5bb96f4cf7b5 with status ACTIVE [ 1041.385753] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.385855] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.385920] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.386159] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.386251] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.386429] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.386527] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.386590] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.386737] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.386815] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.386996] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.387100] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.387162] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.387295] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.387369] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.387452] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3c15cedc-76d5-46e9-bf85-5bb96f4cf7b5 is going to be updated. [ 1041.405896] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.406047] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.407633] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.407633] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.407633] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.407633] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3c15cedc-76d5-46e9-bf85-5bb96f4cf7b5" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.730748] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bec5fbed-ec5a-4f98-90d3-ee0000b97d09 in Status: SUCCESS [ 1042.731100] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bec5fbed-ec5a-4f98-90d3-ee0000b97d09" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.731340] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bec5fbed-ec5a-4f98-90d3-ee0000b97d09" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.731653] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bec5fbed-ec5a-4f98-90d3-ee0000b97d09" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.732035] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.732222] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.732320] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.732558] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.732684] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.732996] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bec5fbed-ec5a-4f98-90d3-ee0000b97d09',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1043.137949] env[69188]: INFO networking_nsxv3.common.synchronization [req-1bb0644e-6cd9-44ac-b963-b0ca89e90d0f req-4a9e9eb5-019a-4e86-9a75-e203b49d90e1 tempest-ImagesTestJSON-2034330654 tempest-ImagesTestJSON-2034330654-project-member] Enqueued Resource ID: 199db626-eef5-4a20-b92a-585841c1cff4 with Priority: HIGHEST for action security_group_members [ 1043.138813] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 199db626-eef5-4a20-b92a-585841c1cff4 with Priority: HIGHEST for action security_group_members [ 1043.139194] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-199db626-eef5-4a20-b92a-585841c1cff4 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.139331] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-199db626-eef5-4a20-b92a-585841c1cff4" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.139511] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-199db626-eef5-4a20-b92a-585841c1cff4" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.139724] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-199db626-eef5-4a20-b92a-585841c1cff4" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.139941] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.140012] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.140507] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.140507] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.140507] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.140507] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('199db626-eef5-4a20-b92a-585841c1cff4',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1043.235818] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bec5fbed-ec5a-4f98-90d3-ee0000b97d09',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1043.609614] env[69188]: INFO networking_nsxv3.common.synchronization [req-a0d37def-7023-42f6-9f8f-132e875355a2 req-2fd5022f-aaec-40a7-adf9-5dd356e36df7 tempest-DeleteServersTestJSON-857706435 tempest-DeleteServersTestJSON-857706435-project-member] Enqueued Resource ID: 397559b2-3c5a-424d-b09d-43a25d2abba6 with Priority: HIGHEST for action security_group_members [ 1043.609614] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 397559b2-3c5a-424d-b09d-43a25d2abba6 with Priority: HIGHEST for action security_group_members [ 1043.609614] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-397559b2-3c5a-424d-b09d-43a25d2abba6 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.609821] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-397559b2-3c5a-424d-b09d-43a25d2abba6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.609821] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-397559b2-3c5a-424d-b09d-43a25d2abba6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.609993] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-397559b2-3c5a-424d-b09d-43a25d2abba6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.610197] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.610363] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.610363] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.610437] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.610513] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.610605] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('397559b2-3c5a-424d-b09d-43a25d2abba6',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1043.643722] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.644103] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.644103] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.644203] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.644260] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.644554] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.644652] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.644704] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.644878] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.644958] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.645060] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 199db626-eef5-4a20-b92a-585841c1cff4 is going to be updated. [ 1043.669631] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.669768] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.669839] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.670052] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.670195] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.679878] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 199db626-eef5-4a20-b92a-585841c1cff4 in Status: IN_PROGRESS for 2s [ 1043.739017] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bec5fbed-ec5a-4f98-90d3-ee0000b97d09',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1043.952028] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock network-449 taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.952028] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "network-449" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.952028] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "network-449" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.952028] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "network-449" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.952028] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.952028] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.952028] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.952350] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.952350] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.952480] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1043.952598] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] NeedRegenerationException {{(pid=69188) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1043.952711] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] no value, waiting for create lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1043.952823] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] value creation lock acquired {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1043.952938] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1043.953061] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Calling creation function for not-yet-present value {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1043.953203] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1043.972066] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1043.972244] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69188) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1043.972384] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Released creation lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1043.972561] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "network-449" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.972950] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock port-01c319a1-f743-47bf-8816-dd4c925f72e8 taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.973129] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "port-01c319a1-f743-47bf-8816-dd4c925f72e8" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.973255] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "port-01c319a1-f743-47bf-8816-dd4c925f72e8" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.973564] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "port-01c319a1-f743-47bf-8816-dd4c925f72e8" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.973714] env[69188]: DEBUG networking_nsxv3.api.rpc [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('01c319a1-f743-47bf-8816-dd4c925f72e8',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1044.114569] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.114803] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.114803] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.115016] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.115125] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.115337] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.115435] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.115518] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.115651] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.115752] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.115842] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 397559b2-3c5a-424d-b09d-43a25d2abba6 is going to be updated. [ 1044.140051] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.140051] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.140051] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.140051] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.140051] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.148368] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 397559b2-3c5a-424d-b09d-43a25d2abba6 in Status: IN_PROGRESS for 2s [ 1044.240715] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.240870] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.240943] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.241225] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.241336] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.241443] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bec5fbed-ec5a-4f98-90d3-ee0000b97d09 is going to be updated. [ 1044.269484] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.269630] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.269701] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.269898] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.270051] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.278060] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bec5fbed-ec5a-4f98-90d3-ee0000b97d09 in Status: IN_PROGRESS for 2s [ 1044.476194] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.476194] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.476194] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.476517] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.476718] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.476915] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Segment Port 01c319a1-f743-47bf-8816-dd4c925f72e8 not found, creating... [ 1044.477242] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.477512] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.477678] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.477904] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.478062] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.478353] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.478526] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.479023] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.479023] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.479023] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.479145] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Resource: SegmentPort with ID: 01c319a1-f743-47bf-8816-dd4c925f72e8 is going to be created. [ 1044.498440] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.498680] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.498811] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.499079] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.499310] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.499561] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "port-01c319a1-f743-47bf-8816-dd4c925f72e8" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.283081] env[69188]: INFO networking_nsxv3.common.synchronization [req-a0d37def-7023-42f6-9f8f-132e875355a2 req-1d8fec3e-c462-4cf3-96a8-9656f864f931 service nova] Enqueued Resource ID: 397559b2-3c5a-424d-b09d-43a25d2abba6 with Priority: HIGHEST for action security_group_rules [ 1045.283081] env[69188]: INFO networking_nsxv3.common.synchronization [req-a0d37def-7023-42f6-9f8f-132e875355a2 req-1d8fec3e-c462-4cf3-96a8-9656f864f931 service nova] Enqueued Resource ID: 397559b2-3c5a-424d-b09d-43a25d2abba6 with Priority: HIGHEST for action security_group_members [ 1045.283081] env[69188]: INFO networking_nsxv3.common.synchronization [req-a0d37def-7023-42f6-9f8f-132e875355a2 req-1d8fec3e-c462-4cf3-96a8-9656f864f931 service nova] Enqueued Resource ID: 01c319a1-f743-47bf-8816-dd4c925f72e8 with Priority: HIGHEST for action port [ 1045.283432] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 397559b2-3c5a-424d-b09d-43a25d2abba6 with Priority: HIGHEST for action security_group_rules [ 1045.283432] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 397559b2-3c5a-424d-b09d-43a25d2abba6 with Priority: HIGHEST for action security_group_members [ 1045.283432] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 01c319a1-f743-47bf-8816-dd4c925f72e8 with Priority: HIGHEST for action port [ 1045.283918] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-397559b2-3c5a-424d-b09d-43a25d2abba6 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.288741] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-397559b2-3c5a-424d-b09d-43a25d2abba6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.288819] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-397559b2-3c5a-424d-b09d-43a25d2abba6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.289050] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-397559b2-3c5a-424d-b09d-43a25d2abba6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.289141] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('397559b2-3c5a-424d-b09d-43a25d2abba6',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1045.292972] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-397559b2-3c5a-424d-b09d-43a25d2abba6 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.292972] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-397559b2-3c5a-424d-b09d-43a25d2abba6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.292972] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-01c319a1-f743-47bf-8816-dd4c925f72e8 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.292972] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-01c319a1-f743-47bf-8816-dd4c925f72e8" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.292972] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-01c319a1-f743-47bf-8816-dd4c925f72e8" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.292972] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-01c319a1-f743-47bf-8816-dd4c925f72e8" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.292972] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('01c319a1-f743-47bf-8816-dd4c925f72e8',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1045.688720] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 199db626-eef5-4a20-b92a-585841c1cff4 in Status: SUCCESS [ 1045.688934] env[69188]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 199db626-eef5-4a20-b92a-585841c1cff4 deletion is rescheduled due to dependency. [ 1045.689079] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-199db626-eef5-4a20-b92a-585841c1cff4" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.792162] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-397559b2-3c5a-424d-b09d-43a25d2abba6 taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.792334] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-397559b2-3c5a-424d-b09d-43a25d2abba6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.792492] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 01c319a1-f743-47bf-8816-dd4c925f72e8 with status ACTIVE [ 1045.792657] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.792781] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.792919] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.793104] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.793296] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.793441] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.793626] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.793626] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.793818] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.793876] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.794042] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.794135] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.794214] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.794353] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.794408] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.794493] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 01c319a1-f743-47bf-8816-dd4c925f72e8 is going to be updated. [ 1045.818065] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.818065] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.818065] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.818065] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.818065] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.818065] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-01c319a1-f743-47bf-8816-dd4c925f72e8" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.073235] env[69188]: INFO networking_nsxv3.common.synchronization [req-29622bc5-33db-48ed-a26d-35c9c1e805d3 req-36bf9b30-9a92-40ad-834b-77b93efd1c14 tempest-ServersTestManualDisk-291117102 tempest-ServersTestManualDisk-291117102-project-member] Enqueued Resource ID: 6551850f-c3f5-470f-b5eb-f7d542ab3a90 with Priority: HIGHEST for action security_group_members [ 1046.073704] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6551850f-c3f5-470f-b5eb-f7d542ab3a90 with Priority: HIGHEST for action security_group_members [ 1046.074435] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-6551850f-c3f5-470f-b5eb-f7d542ab3a90 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.074569] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6551850f-c3f5-470f-b5eb-f7d542ab3a90" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.075680] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6551850f-c3f5-470f-b5eb-f7d542ab3a90" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.075995] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6551850f-c3f5-470f-b5eb-f7d542ab3a90" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.076519] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.076519] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.076519] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.076519] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.076804] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.076804] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6551850f-c3f5-470f-b5eb-f7d542ab3a90',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1046.161895] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 397559b2-3c5a-424d-b09d-43a25d2abba6 in Status: SUCCESS [ 1046.161895] env[69188]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 397559b2-3c5a-424d-b09d-43a25d2abba6 deletion is rescheduled due to dependency. [ 1046.161895] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-397559b2-3c5a-424d-b09d-43a25d2abba6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.161895] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-397559b2-3c5a-424d-b09d-43a25d2abba6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.161895] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-397559b2-3c5a-424d-b09d-43a25d2abba6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.161895] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.161895] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.161895] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.161895] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.161895] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.161895] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('397559b2-3c5a-424d-b09d-43a25d2abba6',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1046.291104] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bec5fbed-ec5a-4f98-90d3-ee0000b97d09 in Status: SUCCESS [ 1046.291724] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bec5fbed-ec5a-4f98-90d3-ee0000b97d09" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.294159] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bec5fbed-ec5a-4f98-90d3-ee0000b97d09" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.294159] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bec5fbed-ec5a-4f98-90d3-ee0000b97d09" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.294159] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.294159] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.294159] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.294159] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.294159] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.294159] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bec5fbed-ec5a-4f98-90d3-ee0000b97d09',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1046.509871] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock network-881 taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.510169] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "network-881" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.510343] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "network-881" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.510731] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "network-881" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.511375] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.511621] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.511776] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.512023] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.512181] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.512396] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1046.512515] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] NeedRegenerationException {{(pid=69188) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1046.512633] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] no value, waiting for create lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1046.512743] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] value creation lock acquired {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1046.512852] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1046.512961] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Calling creation function for not-yet-present value {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1046.513107] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1046.531464] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1046.531578] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69188) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1046.531722] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Released creation lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1046.531944] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "network-881" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.532286] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock port-2749b4fb-a445-43df-8c83-007f937ab89d taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.532461] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "port-2749b4fb-a445-43df-8c83-007f937ab89d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.532585] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "port-2749b4fb-a445-43df-8c83-007f937ab89d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.532895] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "port-2749b4fb-a445-43df-8c83-007f937ab89d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.533047] env[69188]: DEBUG networking_nsxv3.api.rpc [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2749b4fb-a445-43df-8c83-007f937ab89d',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1046.578672] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.578857] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.578910] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.579135] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.579229] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.579464] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.579637] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.579637] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.579784] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.579835] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.579927] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6551850f-c3f5-470f-b5eb-f7d542ab3a90 already deleted. [ 1046.580014] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6551850f-c3f5-470f-b5eb-f7d542ab3a90" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.664655] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('397559b2-3c5a-424d-b09d-43a25d2abba6',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1046.795306] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bec5fbed-ec5a-4f98-90d3-ee0000b97d09',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1047.034931] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.035139] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.035272] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.035642] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.035870] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.036076] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Segment Port 2749b4fb-a445-43df-8c83-007f937ab89d not found, creating... [ 1047.036407] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.036589] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.036749] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.037053] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.037254] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.037706] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.037890] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.038043] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.038293] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.038443] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.038604] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Resource: SegmentPort with ID: 2749b4fb-a445-43df-8c83-007f937ab89d is going to be created. [ 1047.057143] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.057286] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.057449] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.057827] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.058116] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.058399] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "port-2749b4fb-a445-43df-8c83-007f937ab89d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.167214] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('397559b2-3c5a-424d-b09d-43a25d2abba6',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1047.297596] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bec5fbed-ec5a-4f98-90d3-ee0000b97d09',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1047.669548] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.669858] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.669858] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.670072] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.670549] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.670549] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 397559b2-3c5a-424d-b09d-43a25d2abba6 is going to be updated. [ 1047.703106] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.703251] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.703338] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.703646] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.703793] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.711805] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 397559b2-3c5a-424d-b09d-43a25d2abba6 in Status: IN_PROGRESS for 2s [ 1047.766712] env[69188]: INFO networking_nsxv3.common.synchronization [req-29622bc5-33db-48ed-a26d-35c9c1e805d3 req-8411c1fe-e6b5-4136-bd7c-ec9da1c51101 service nova] Enqueued Resource ID: 6551850f-c3f5-470f-b5eb-f7d542ab3a90 with Priority: HIGHEST for action security_group_rules [ 1047.770159] env[69188]: INFO networking_nsxv3.common.synchronization [req-29622bc5-33db-48ed-a26d-35c9c1e805d3 req-8411c1fe-e6b5-4136-bd7c-ec9da1c51101 service nova] Enqueued Resource ID: 6551850f-c3f5-470f-b5eb-f7d542ab3a90 with Priority: HIGHEST for action security_group_members [ 1047.770159] env[69188]: INFO networking_nsxv3.common.synchronization [req-29622bc5-33db-48ed-a26d-35c9c1e805d3 req-8411c1fe-e6b5-4136-bd7c-ec9da1c51101 service nova] Enqueued Resource ID: 2749b4fb-a445-43df-8c83-007f937ab89d with Priority: HIGHEST for action port [ 1047.770159] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6551850f-c3f5-470f-b5eb-f7d542ab3a90 with Priority: HIGHEST for action security_group_rules [ 1047.770159] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6551850f-c3f5-470f-b5eb-f7d542ab3a90 with Priority: HIGHEST for action security_group_members [ 1047.770487] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2749b4fb-a445-43df-8c83-007f937ab89d with Priority: HIGHEST for action port [ 1047.770618] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6551850f-c3f5-470f-b5eb-f7d542ab3a90 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.770618] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6551850f-c3f5-470f-b5eb-f7d542ab3a90" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.770770] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6551850f-c3f5-470f-b5eb-f7d542ab3a90" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.770999] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6551850f-c3f5-470f-b5eb-f7d542ab3a90" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.771089] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6551850f-c3f5-470f-b5eb-f7d542ab3a90',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1047.771962] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-6551850f-c3f5-470f-b5eb-f7d542ab3a90 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.772096] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6551850f-c3f5-470f-b5eb-f7d542ab3a90" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.772162] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6551850f-c3f5-470f-b5eb-f7d542ab3a90" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.772332] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6551850f-c3f5-470f-b5eb-f7d542ab3a90" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.772473] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.772561] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.772619] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.772748] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.772829] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.772914] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6551850f-c3f5-470f-b5eb-f7d542ab3a90',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1047.773681] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-2749b4fb-a445-43df-8c83-007f937ab89d taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.773775] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2749b4fb-a445-43df-8c83-007f937ab89d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.773835] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2749b4fb-a445-43df-8c83-007f937ab89d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.773988] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2749b4fb-a445-43df-8c83-007f937ab89d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.774070] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2749b4fb-a445-43df-8c83-007f937ab89d',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1047.800296] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.800411] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.800470] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.800659] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.800751] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.800852] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bec5fbed-ec5a-4f98-90d3-ee0000b97d09 is going to be updated. [ 1047.830187] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.830303] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.830381] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.830605] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.831063] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.841247] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bec5fbed-ec5a-4f98-90d3-ee0000b97d09 in Status: IN_PROGRESS for 2s [ 1048.275452] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6551850f-c3f5-470f-b5eb-f7d542ab3a90',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1048.276418] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-6551850f-c3f5-470f-b5eb-f7d542ab3a90 taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.276541] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6551850f-c3f5-470f-b5eb-f7d542ab3a90" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.276825] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2749b4fb-a445-43df-8c83-007f937ab89d with status ACTIVE [ 1048.276987] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.277106] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.277191] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.277531] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.277531] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.277746] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.277746] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.277835] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.277962] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.278058] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.278224] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.278456] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.278456] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.278579] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.278579] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.278723] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2749b4fb-a445-43df-8c83-007f937ab89d is going to be updated. [ 1048.300580] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.300897] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.300897] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.301082] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.301244] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.301408] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2749b4fb-a445-43df-8c83-007f937ab89d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.777743] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6551850f-c3f5-470f-b5eb-f7d542ab3a90',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.280397] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.280691] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.280776] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.281034] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.281141] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.281475] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6551850f-c3f5-470f-b5eb-f7d542ab3a90 is going to be created. [ 1049.305565] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.305565] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.305854] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.305854] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.306011] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.315346] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6551850f-c3f5-470f-b5eb-f7d542ab3a90 in Status: UNINITIALIZED for 2s [ 1049.721519] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 397559b2-3c5a-424d-b09d-43a25d2abba6 in Status: SUCCESS [ 1049.721729] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-397559b2-3c5a-424d-b09d-43a25d2abba6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.721904] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-397559b2-3c5a-424d-b09d-43a25d2abba6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.722200] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-397559b2-3c5a-424d-b09d-43a25d2abba6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.722673] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.722673] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.722673] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.722877] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.722877] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.722970] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-397559b2-3c5a-424d-b09d-43a25d2abba6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.723558] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('397559b2-3c5a-424d-b09d-43a25d2abba6',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.850959] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bec5fbed-ec5a-4f98-90d3-ee0000b97d09 in Status: SUCCESS [ 1049.850959] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bec5fbed-ec5a-4f98-90d3-ee0000b97d09" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.850959] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bec5fbed-ec5a-4f98-90d3-ee0000b97d09" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.850959] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bec5fbed-ec5a-4f98-90d3-ee0000b97d09" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.851179] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.851179] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.851337] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.851517] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.851600] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.851686] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bec5fbed-ec5a-4f98-90d3-ee0000b97d09" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.851864] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-bec5fbed-ec5a-4f98-90d3-ee0000b97d09 taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.851948] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bec5fbed-ec5a-4f98-90d3-ee0000b97d09" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.851948] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bec5fbed-ec5a-4f98-90d3-ee0000b97d09" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.852177] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bec5fbed-ec5a-4f98-90d3-ee0000b97d09" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.852319] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.852436] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.852501] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.852643] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.852727] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.852813] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bec5fbed-ec5a-4f98-90d3-ee0000b97d09" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.852892] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('bec5fbed-ec5a-4f98-90d3-ee0000b97d09',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.853715] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bec5fbed-ec5a-4f98-90d3-ee0000b97d09" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.853881] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bec5fbed-ec5a-4f98-90d3-ee0000b97d09" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.854039] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.854140] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.854202] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.854336] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.854428] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.854509] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bec5fbed-ec5a-4f98-90d3-ee0000b97d09',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1050.225438] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-397559b2-3c5a-424d-b09d-43a25d2abba6 taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.225661] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-397559b2-3c5a-424d-b09d-43a25d2abba6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.225661] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-397559b2-3c5a-424d-b09d-43a25d2abba6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.225893] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-397559b2-3c5a-424d-b09d-43a25d2abba6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.226070] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.226171] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.226233] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.226381] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.226463] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.226555] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-397559b2-3c5a-424d-b09d-43a25d2abba6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.226703] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-397559b2-3c5a-424d-b09d-43a25d2abba6 taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.226782] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-397559b2-3c5a-424d-b09d-43a25d2abba6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.226838] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-397559b2-3c5a-424d-b09d-43a25d2abba6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.227015] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-397559b2-3c5a-424d-b09d-43a25d2abba6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.227172] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.227266] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.227315] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.227454] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.227547] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.227627] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-397559b2-3c5a-424d-b09d-43a25d2abba6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.227818] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('397559b2-3c5a-424d-b09d-43a25d2abba6',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1050.355682] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for bec5fbed-ec5a-4f98-90d3-ee0000b97d09: rpc.has_security_group_logging(os_id): False [ 1050.356776] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bec5fbed-ec5a-4f98-90d3-ee0000b97d09',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1050.373924] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.374075] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.374150] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.374359] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.374454] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.374643] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.374750] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.374822] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.374994] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.375087] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.375282] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.375375] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.375436] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.375574] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.375646] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.375824] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.375913] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.376011] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.376117] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.376190] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.376272] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bec5fbed-ec5a-4f98-90d3-ee0000b97d09 is going to be created. [ 1050.439371] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.439583] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.439680] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.439896] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.440090] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.450520] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bec5fbed-ec5a-4f98-90d3-ee0000b97d09 in Status: IN_PROGRESS for 2s [ 1050.730264] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 397559b2-3c5a-424d-b09d-43a25d2abba6: rpc.has_security_group_logging(os_id): False [ 1050.749938] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.750574] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.750574] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.750574] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.750574] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.750735] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.750785] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.750860] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.751014] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.751098] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.751287] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.751425] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.751477] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.751622] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.751742] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.751903] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.752008] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.752077] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.752223] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.752298] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.752384] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 397559b2-3c5a-424d-b09d-43a25d2abba6 is going to be updated. [ 1050.808308] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.808477] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.808531] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.808726] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.808870] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.820615] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 397559b2-3c5a-424d-b09d-43a25d2abba6 in Status: IN_PROGRESS for 2s [ 1050.859182] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bec5fbed-ec5a-4f98-90d3-ee0000b97d09',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.326567] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6551850f-c3f5-470f-b5eb-f7d542ab3a90 in Status: SUCCESS [ 1051.327096] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6551850f-c3f5-470f-b5eb-f7d542ab3a90" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.327192] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6551850f-c3f5-470f-b5eb-f7d542ab3a90" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.328295] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6551850f-c3f5-470f-b5eb-f7d542ab3a90" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.328295] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.328295] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.328295] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.328295] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.328295] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.328563] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6551850f-c3f5-470f-b5eb-f7d542ab3a90" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.328563] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6551850f-c3f5-470f-b5eb-f7d542ab3a90',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.361165] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.361562] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.361562] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.361659] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.361719] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.361784] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bec5fbed-ec5a-4f98-90d3-ee0000b97d09 is going to be updated. [ 1051.390443] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.390617] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.390709] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.390934] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.391093] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.402970] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bec5fbed-ec5a-4f98-90d3-ee0000b97d09 in Status: IN_PROGRESS for 2s [ 1051.830943] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6551850f-c3f5-470f-b5eb-f7d542ab3a90',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.155985] env[69188]: INFO networking_nsxv3.common.synchronization [req-6699d036-4f4e-4eaa-89d3-48cef1fede80 req-7e81672e-4b17-4e61-bb16-caa9587830d7 tempest-ListServersNegativeTestJSON-350712182 tempest-ListServersNegativeTestJSON-350712182-project-member] Enqueued Resource ID: bec5fbed-ec5a-4f98-90d3-ee0000b97d09 with Priority: HIGHEST for action security_group_members [ 1052.156609] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bec5fbed-ec5a-4f98-90d3-ee0000b97d09 with Priority: HIGHEST for action security_group_members [ 1052.160062] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-bec5fbed-ec5a-4f98-90d3-ee0000b97d09 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.160062] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bec5fbed-ec5a-4f98-90d3-ee0000b97d09" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.334289] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6551850f-c3f5-470f-b5eb-f7d542ab3a90: rpc.has_security_group_logging(os_id): False [ 1052.353025] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.353025] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.353025] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.353025] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.353025] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.353025] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.353025] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.353025] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.353025] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.353025] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.353025] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6551850f-c3f5-470f-b5eb-f7d542ab3a90 is going to be created. [ 1052.408828] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.409297] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.409297] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.409297] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.409603] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.420011] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6551850f-c3f5-470f-b5eb-f7d542ab3a90 in Status: IN_PROGRESS for 2s [ 1052.461654] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bec5fbed-ec5a-4f98-90d3-ee0000b97d09 in Status: SUCCESS [ 1052.462139] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bec5fbed-ec5a-4f98-90d3-ee0000b97d09" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.463053] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bec5fbed-ec5a-4f98-90d3-ee0000b97d09" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.463340] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bec5fbed-ec5a-4f98-90d3-ee0000b97d09" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.463435] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bec5fbed-ec5a-4f98-90d3-ee0000b97d09',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.535798] env[69188]: INFO networking_nsxv3.common.synchronization [req-3a86ac35-c38c-40fa-862d-81f2218e4831 req-69094883-cbe7-4f42-90b8-1640db075e08 tempest-AttachInterfacesTestJSON-1255877948 tempest-AttachInterfacesTestJSON-1255877948-project-member] Enqueued Resource ID: 12570d95-0a4a-4579-82c8-53ecf65f714e with Priority: HIGHEST for action security_group_members [ 1052.536369] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 12570d95-0a4a-4579-82c8-53ecf65f714e with Priority: HIGHEST for action security_group_members [ 1052.536713] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-12570d95-0a4a-4579-82c8-53ecf65f714e taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.536865] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-12570d95-0a4a-4579-82c8-53ecf65f714e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.537561] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-12570d95-0a4a-4579-82c8-53ecf65f714e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.537561] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-12570d95-0a4a-4579-82c8-53ecf65f714e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.537561] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.537561] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.537561] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.537858] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.537858] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.537858] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('12570d95-0a4a-4579-82c8-53ecf65f714e',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.838386] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 397559b2-3c5a-424d-b09d-43a25d2abba6 in Status: SUCCESS [ 1052.838726] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-397559b2-3c5a-424d-b09d-43a25d2abba6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.965514] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-bec5fbed-ec5a-4f98-90d3-ee0000b97d09 taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.965656] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bec5fbed-ec5a-4f98-90d3-ee0000b97d09" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.014670] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock network-51 taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.014822] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "network-51" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.014951] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "network-51" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.015254] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "network-51" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.015520] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.015692] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.015815] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.016092] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.016254] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.016467] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1053.016590] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] NeedRegenerationException {{(pid=69188) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1053.016704] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] no value, waiting for create lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1053.016816] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] value creation lock acquired {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1053.016930] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1053.017097] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Calling creation function for not-yet-present value {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1053.017262] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1053.035581] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1053.035773] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69188) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1053.035973] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Released creation lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1053.036115] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "network-51" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.036433] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock port-bf08a76c-bbc9-46d9-a056-fcb747eef82c taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.036599] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "port-bf08a76c-bbc9-46d9-a056-fcb747eef82c" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.036723] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "port-bf08a76c-bbc9-46d9-a056-fcb747eef82c" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.037064] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "port-bf08a76c-bbc9-46d9-a056-fcb747eef82c" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.037212] env[69188]: DEBUG networking_nsxv3.api.rpc [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bf08a76c-bbc9-46d9-a056-fcb747eef82c',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.039865] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.039925] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.039955] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.040136] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.040218] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.040397] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.040520] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.040610] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.040710] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.040788] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.040874] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 12570d95-0a4a-4579-82c8-53ecf65f714e already deleted. [ 1053.040950] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-12570d95-0a4a-4579-82c8-53ecf65f714e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.412335] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bec5fbed-ec5a-4f98-90d3-ee0000b97d09 in Status: SUCCESS [ 1053.412602] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bec5fbed-ec5a-4f98-90d3-ee0000b97d09" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.412707] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bec5fbed-ec5a-4f98-90d3-ee0000b97d09" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.412921] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bec5fbed-ec5a-4f98-90d3-ee0000b97d09" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.413150] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.413282] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.413350] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.413508] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.413593] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.413690] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bec5fbed-ec5a-4f98-90d3-ee0000b97d09',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.540049] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.540247] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.540350] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.540694] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.540876] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.541058] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Segment Port bf08a76c-bbc9-46d9-a056-fcb747eef82c not found, creating... [ 1053.541327] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.541490] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.541615] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.541878] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.542061] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.542359] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.542519] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.542664] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.542894] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.543050] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.543201] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Resource: SegmentPort with ID: bf08a76c-bbc9-46d9-a056-fcb747eef82c is going to be created. [ 1053.561736] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.562012] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.562168] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.562421] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.562654] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.562882] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "port-bf08a76c-bbc9-46d9-a056-fcb747eef82c" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.915617] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bec5fbed-ec5a-4f98-90d3-ee0000b97d09',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.348038] env[69188]: INFO networking_nsxv3.common.synchronization [req-3a86ac35-c38c-40fa-862d-81f2218e4831 req-615c032c-7091-4988-a306-73a97e9abbfe service nova] Enqueued Resource ID: 12570d95-0a4a-4579-82c8-53ecf65f714e with Priority: HIGHEST for action security_group_rules [ 1054.348245] env[69188]: INFO networking_nsxv3.common.synchronization [req-3a86ac35-c38c-40fa-862d-81f2218e4831 req-615c032c-7091-4988-a306-73a97e9abbfe service nova] Enqueued Resource ID: 12570d95-0a4a-4579-82c8-53ecf65f714e with Priority: HIGHEST for action security_group_members [ 1054.348388] env[69188]: INFO networking_nsxv3.common.synchronization [req-3a86ac35-c38c-40fa-862d-81f2218e4831 req-615c032c-7091-4988-a306-73a97e9abbfe service nova] Enqueued Resource ID: bf08a76c-bbc9-46d9-a056-fcb747eef82c with Priority: HIGHEST for action port [ 1054.348613] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 12570d95-0a4a-4579-82c8-53ecf65f714e with Priority: HIGHEST for action security_group_rules [ 1054.348739] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 12570d95-0a4a-4579-82c8-53ecf65f714e with Priority: HIGHEST for action security_group_members [ 1054.348832] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bf08a76c-bbc9-46d9-a056-fcb747eef82c with Priority: HIGHEST for action port [ 1054.349543] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-12570d95-0a4a-4579-82c8-53ecf65f714e taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.349543] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-12570d95-0a4a-4579-82c8-53ecf65f714e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.349694] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-12570d95-0a4a-4579-82c8-53ecf65f714e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.349863] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-12570d95-0a4a-4579-82c8-53ecf65f714e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.349943] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('12570d95-0a4a-4579-82c8-53ecf65f714e',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.355180] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-12570d95-0a4a-4579-82c8-53ecf65f714e taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.355180] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-12570d95-0a4a-4579-82c8-53ecf65f714e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.355180] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-12570d95-0a4a-4579-82c8-53ecf65f714e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.355652] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-12570d95-0a4a-4579-82c8-53ecf65f714e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.355826] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.355931] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.355997] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.356173] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.356260] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.356352] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('12570d95-0a4a-4579-82c8-53ecf65f714e',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.357891] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-bf08a76c-bbc9-46d9-a056-fcb747eef82c taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.357891] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bf08a76c-bbc9-46d9-a056-fcb747eef82c" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.358014] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bf08a76c-bbc9-46d9-a056-fcb747eef82c" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.358101] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bf08a76c-bbc9-46d9-a056-fcb747eef82c" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.358182] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bf08a76c-bbc9-46d9-a056-fcb747eef82c',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.418706] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bec5fbed-ec5a-4f98-90d3-ee0000b97d09',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.430849] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6551850f-c3f5-470f-b5eb-f7d542ab3a90 in Status: SUCCESS [ 1054.431105] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6551850f-c3f5-470f-b5eb-f7d542ab3a90" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.855829] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-12570d95-0a4a-4579-82c8-53ecf65f714e taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.856034] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-12570d95-0a4a-4579-82c8-53ecf65f714e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.858445] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('12570d95-0a4a-4579-82c8-53ecf65f714e',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.859608] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bf08a76c-bbc9-46d9-a056-fcb747eef82c with status ACTIVE [ 1054.862956] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.862956] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.862956] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.862956] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.862956] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.862956] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.862956] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.862956] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.862956] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.862956] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.862956] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.862956] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.862956] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.862956] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.862956] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.862956] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bf08a76c-bbc9-46d9-a056-fcb747eef82c is going to be updated. [ 1054.886203] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.886370] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.886440] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.886645] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.886786] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.886951] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bf08a76c-bbc9-46d9-a056-fcb747eef82c" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.922617] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.922617] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.922617] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.922791] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.922939] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.922994] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bec5fbed-ec5a-4f98-90d3-ee0000b97d09 is going to be updated. [ 1054.952989] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.952989] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.952989] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.952989] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.952989] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.962449] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bec5fbed-ec5a-4f98-90d3-ee0000b97d09 in Status: IN_PROGRESS for 2s [ 1055.364440] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('12570d95-0a4a-4579-82c8-53ecf65f714e',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.869172] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.869483] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.869483] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.869769] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.869887] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.870026] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 12570d95-0a4a-4579-82c8-53ecf65f714e is going to be created. [ 1055.892805] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.892805] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.892951] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.893113] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.893272] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.901520] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 12570d95-0a4a-4579-82c8-53ecf65f714e in Status: UNINITIALIZED for 2s [ 1056.816391] env[69188]: INFO networking_nsxv3.common.synchronization [req-a6bf0899-7ac8-4de4-a0e0-ccdc6c902438 req-08edb966-53f0-4ad0-8150-b3d37d77551c tempest-ServerActionsTestOtherB-2131451762 tempest-ServerActionsTestOtherB-2131451762-project-member] Enqueued Resource ID: 867581e0-cbbd-4108-a823-0b7c53d47c3a with Priority: HIGHEST for action security_group_members [ 1056.816915] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 867581e0-cbbd-4108-a823-0b7c53d47c3a with Priority: HIGHEST for action security_group_members [ 1056.822035] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-867581e0-cbbd-4108-a823-0b7c53d47c3a taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.822035] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-867581e0-cbbd-4108-a823-0b7c53d47c3a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.822035] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-867581e0-cbbd-4108-a823-0b7c53d47c3a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.822035] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-867581e0-cbbd-4108-a823-0b7c53d47c3a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.822035] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.822035] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.822035] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.822035] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.822035] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.822035] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('867581e0-cbbd-4108-a823-0b7c53d47c3a',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1056.974855] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bec5fbed-ec5a-4f98-90d3-ee0000b97d09 in Status: SUCCESS [ 1056.974855] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bec5fbed-ec5a-4f98-90d3-ee0000b97d09" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.974855] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bec5fbed-ec5a-4f98-90d3-ee0000b97d09" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.974855] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bec5fbed-ec5a-4f98-90d3-ee0000b97d09" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.974855] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.974855] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.974855] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.974855] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.974855] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.974855] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bec5fbed-ec5a-4f98-90d3-ee0000b97d09" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.974855] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('bec5fbed-ec5a-4f98-90d3-ee0000b97d09',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1057.325008] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.325304] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.325413] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.325629] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.345603] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.345854] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.345983] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.346064] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.346337] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.346337] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.346435] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 867581e0-cbbd-4108-a823-0b7c53d47c3a is going to be updated. [ 1057.384566] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.384733] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.384765] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.384981] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.385137] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.404174] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 867581e0-cbbd-4108-a823-0b7c53d47c3a in Status: IN_PROGRESS for 2s [ 1057.480976] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-bec5fbed-ec5a-4f98-90d3-ee0000b97d09 taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.480976] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bec5fbed-ec5a-4f98-90d3-ee0000b97d09" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.480976] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bec5fbed-ec5a-4f98-90d3-ee0000b97d09" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.480976] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bec5fbed-ec5a-4f98-90d3-ee0000b97d09" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.480976] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.480976] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.480976] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.480976] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.480976] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.480976] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bec5fbed-ec5a-4f98-90d3-ee0000b97d09" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.480976] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-bec5fbed-ec5a-4f98-90d3-ee0000b97d09 taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.480976] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bec5fbed-ec5a-4f98-90d3-ee0000b97d09" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.480976] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bec5fbed-ec5a-4f98-90d3-ee0000b97d09" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.480976] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bec5fbed-ec5a-4f98-90d3-ee0000b97d09" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.480976] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.480976] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.481502] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.481502] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.481502] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.481502] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bec5fbed-ec5a-4f98-90d3-ee0000b97d09" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.481502] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('bec5fbed-ec5a-4f98-90d3-ee0000b97d09',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1057.700503] env[69188]: INFO networking_nsxv3.common.synchronization [req-062d0200-23b5-48a3-9fde-120204496d72 req-99c3a8b4-03ed-4f89-9d3b-e43cfe87f442 tempest-ServersTestJSON-1495057482 tempest-ServersTestJSON-1495057482-project-member] Enqueued Resource ID: 9f2518e8-b195-4520-b262-caa765ab7e27 with Priority: HIGHEST for action security_group_members [ 1057.701060] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f2518e8-b195-4520-b262-caa765ab7e27 with Priority: HIGHEST for action security_group_members [ 1057.701409] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-9f2518e8-b195-4520-b262-caa765ab7e27 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.701541] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9f2518e8-b195-4520-b262-caa765ab7e27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.701608] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9f2518e8-b195-4520-b262-caa765ab7e27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.701807] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9f2518e8-b195-4520-b262-caa765ab7e27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.701965] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.702394] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.702487] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.702652] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.702744] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.702842] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9f2518e8-b195-4520-b262-caa765ab7e27',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1057.912033] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 12570d95-0a4a-4579-82c8-53ecf65f714e in Status: SUCCESS [ 1057.912255] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-12570d95-0a4a-4579-82c8-53ecf65f714e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.912798] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-12570d95-0a4a-4579-82c8-53ecf65f714e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.912886] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-12570d95-0a4a-4579-82c8-53ecf65f714e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.916748] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.916748] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.916748] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.916748] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.916748] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.916748] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-12570d95-0a4a-4579-82c8-53ecf65f714e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.916748] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('12570d95-0a4a-4579-82c8-53ecf65f714e',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1057.986556] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for bec5fbed-ec5a-4f98-90d3-ee0000b97d09: rpc.has_security_group_logging(os_id): False [ 1058.005146] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.005146] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.005146] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.005146] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.005146] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.005146] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.005146] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.005146] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.005146] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.005146] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.005146] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.005146] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.005146] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.005146] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.005146] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.005686] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.005686] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.005686] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.005686] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.005686] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.005686] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bec5fbed-ec5a-4f98-90d3-ee0000b97d09 is going to be updated. [ 1058.066752] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.066752] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.066752] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.066752] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.066752] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.076870] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bec5fbed-ec5a-4f98-90d3-ee0000b97d09 in Status: IN_PROGRESS for 2s [ 1058.205115] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9f2518e8-b195-4520-b262-caa765ab7e27',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.420209] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-12570d95-0a4a-4579-82c8-53ecf65f714e taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.420338] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-12570d95-0a4a-4579-82c8-53ecf65f714e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.420446] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-12570d95-0a4a-4579-82c8-53ecf65f714e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.420731] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-12570d95-0a4a-4579-82c8-53ecf65f714e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.420905] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.421017] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.421087] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.421234] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.421323] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.421408] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-12570d95-0a4a-4579-82c8-53ecf65f714e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.421552] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-12570d95-0a4a-4579-82c8-53ecf65f714e taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.421642] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-12570d95-0a4a-4579-82c8-53ecf65f714e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.421703] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-12570d95-0a4a-4579-82c8-53ecf65f714e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.421840] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-12570d95-0a4a-4579-82c8-53ecf65f714e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.421973] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.422081] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.422143] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.422279] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.422353] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.422433] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-12570d95-0a4a-4579-82c8-53ecf65f714e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.422520] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('12570d95-0a4a-4579-82c8-53ecf65f714e',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.468120] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock network-507 taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.468381] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "network-507" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.468532] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "network-507" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.468845] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "network-507" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.469168] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.469709] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.469709] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.469805] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.469943] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.470198] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1058.470318] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] NeedRegenerationException {{(pid=69188) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1058.470432] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] no value, waiting for create lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1058.470544] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] value creation lock acquired {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1058.470687] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1058.470809] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Calling creation function for not-yet-present value {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1058.470951] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1058.494553] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1058.494765] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=69188) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1058.494912] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Released creation lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1058.495112] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "network-507" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.495434] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock port-fb0fcac1-46c2-4a7b-b979-5d372cac3b18 taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.495720] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "port-fb0fcac1-46c2-4a7b-b979-5d372cac3b18" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.495884] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "port-fb0fcac1-46c2-4a7b-b979-5d372cac3b18" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.496349] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "port-fb0fcac1-46c2-4a7b-b979-5d372cac3b18" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.496512] env[69188]: DEBUG networking_nsxv3.api.rpc [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fb0fcac1-46c2-4a7b-b979-5d372cac3b18',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.708411] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9f2518e8-b195-4520-b262-caa765ab7e27',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.925513] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 12570d95-0a4a-4579-82c8-53ecf65f714e: rpc.has_security_group_logging(os_id): False [ 1058.942733] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.942898] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.942971] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.943202] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.943299] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.943522] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.943619] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.943681] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.943859] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.943898] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.944092] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.944184] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.944242] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.944377] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.944449] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.944689] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.945186] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.945186] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.945186] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.945186] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.945186] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 12570d95-0a4a-4579-82c8-53ecf65f714e is going to be created. [ 1058.996365] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.996691] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.996691] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.996758] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.997134] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.998579] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.998768] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.998899] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.999160] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.999308] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.999452] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Segment Port fb0fcac1-46c2-4a7b-b979-5d372cac3b18 not found, creating... [ 1058.999763] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.999882] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.000010] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.000239] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.000403] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.000725] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.000961] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.001015] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.001217] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.001382] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.001485] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Resource: SegmentPort with ID: fb0fcac1-46c2-4a7b-b979-5d372cac3b18 is going to be created. [ 1059.007964] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 12570d95-0a4a-4579-82c8-53ecf65f714e in Status: IN_PROGRESS for 2s [ 1059.023467] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.023746] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.023942] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.024294] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.024489] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.024718] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "port-fb0fcac1-46c2-4a7b-b979-5d372cac3b18" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.212129] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.212129] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.212129] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.212129] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.212129] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.212354] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9f2518e8-b195-4520-b262-caa765ab7e27 is going to be updated. [ 1059.240745] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.240890] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.240962] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.241179] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.241348] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.250079] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9f2518e8-b195-4520-b262-caa765ab7e27 in Status: IN_PROGRESS for 2s [ 1059.418356] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 867581e0-cbbd-4108-a823-0b7c53d47c3a in Status: SUCCESS [ 1059.419613] env[69188]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 867581e0-cbbd-4108-a823-0b7c53d47c3a deletion is rescheduled due to dependency. [ 1059.419998] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-867581e0-cbbd-4108-a823-0b7c53d47c3a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.817552] env[69188]: INFO networking_nsxv3.common.synchronization [req-062d0200-23b5-48a3-9fde-120204496d72 req-b3571aac-183f-4ee9-a913-a0c6d75d441a service nova] Enqueued Resource ID: 9f2518e8-b195-4520-b262-caa765ab7e27 with Priority: HIGHEST for action security_group_rules [ 1059.817552] env[69188]: INFO networking_nsxv3.common.synchronization [req-062d0200-23b5-48a3-9fde-120204496d72 req-b3571aac-183f-4ee9-a913-a0c6d75d441a service nova] Enqueued Resource ID: 9f2518e8-b195-4520-b262-caa765ab7e27 with Priority: HIGHEST for action security_group_members [ 1059.817687] env[69188]: INFO networking_nsxv3.common.synchronization [req-062d0200-23b5-48a3-9fde-120204496d72 req-b3571aac-183f-4ee9-a913-a0c6d75d441a service nova] Enqueued Resource ID: fb0fcac1-46c2-4a7b-b979-5d372cac3b18 with Priority: HIGHEST for action port [ 1059.817885] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f2518e8-b195-4520-b262-caa765ab7e27 with Priority: HIGHEST for action security_group_rules [ 1059.818023] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f2518e8-b195-4520-b262-caa765ab7e27 with Priority: HIGHEST for action security_group_members [ 1059.818163] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb0fcac1-46c2-4a7b-b979-5d372cac3b18 with Priority: HIGHEST for action port [ 1059.822712] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9f2518e8-b195-4520-b262-caa765ab7e27 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.822897] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9f2518e8-b195-4520-b262-caa765ab7e27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.822966] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9f2518e8-b195-4520-b262-caa765ab7e27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.823210] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9f2518e8-b195-4520-b262-caa765ab7e27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.823280] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9f2518e8-b195-4520-b262-caa765ab7e27',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.826531] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-9f2518e8-b195-4520-b262-caa765ab7e27 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.826531] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9f2518e8-b195-4520-b262-caa765ab7e27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.826531] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-fb0fcac1-46c2-4a7b-b979-5d372cac3b18 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.828911] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fb0fcac1-46c2-4a7b-b979-5d372cac3b18" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.828911] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fb0fcac1-46c2-4a7b-b979-5d372cac3b18" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.828911] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fb0fcac1-46c2-4a7b-b979-5d372cac3b18" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.829293] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fb0fcac1-46c2-4a7b-b979-5d372cac3b18',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.090783] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bec5fbed-ec5a-4f98-90d3-ee0000b97d09 in Status: SUCCESS [ 1060.093886] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bec5fbed-ec5a-4f98-90d3-ee0000b97d09" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.093886] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bec5fbed-ec5a-4f98-90d3-ee0000b97d09" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.093886] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bec5fbed-ec5a-4f98-90d3-ee0000b97d09" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.093886] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bec5fbed-ec5a-4f98-90d3-ee0000b97d09',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.332178] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-9f2518e8-b195-4520-b262-caa765ab7e27 taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.332178] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9f2518e8-b195-4520-b262-caa765ab7e27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.332178] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fb0fcac1-46c2-4a7b-b979-5d372cac3b18 with status ACTIVE [ 1060.332178] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.332463] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.332463] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.332592] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.332681] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.332820] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.332946] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.333411] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.333411] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.333411] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.333500] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.333765] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.333765] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.333877] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.333877] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.333957] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fb0fcac1-46c2-4a7b-b979-5d372cac3b18 is going to be updated. [ 1060.354358] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.354499] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.354653] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.354865] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.355000] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.355169] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fb0fcac1-46c2-4a7b-b979-5d372cac3b18" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.594027] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-bec5fbed-ec5a-4f98-90d3-ee0000b97d09 taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.594210] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bec5fbed-ec5a-4f98-90d3-ee0000b97d09" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.594249] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bec5fbed-ec5a-4f98-90d3-ee0000b97d09" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.594463] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bec5fbed-ec5a-4f98-90d3-ee0000b97d09" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.594629] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.594731] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.594805] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.594958] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.595256] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.595256] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bec5fbed-ec5a-4f98-90d3-ee0000b97d09" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.595256] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('bec5fbed-ec5a-4f98-90d3-ee0000b97d09',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.940368] env[69188]: INFO networking_nsxv3.common.synchronization [req-6f4638d5-e6ab-46ee-8460-08f99575f835 req-aa7e786f-da73-4859-8405-cb92938a6aee tempest-DeleteServersTestJSON-857706435 tempest-DeleteServersTestJSON-857706435-project-member] Enqueued Resource ID: 397559b2-3c5a-424d-b09d-43a25d2abba6 with Priority: HIGHEST for action security_group_members [ 1060.941048] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 397559b2-3c5a-424d-b09d-43a25d2abba6 with Priority: HIGHEST for action security_group_members [ 1060.942876] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-397559b2-3c5a-424d-b09d-43a25d2abba6 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.943299] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-397559b2-3c5a-424d-b09d-43a25d2abba6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.943299] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-397559b2-3c5a-424d-b09d-43a25d2abba6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.943423] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-397559b2-3c5a-424d-b09d-43a25d2abba6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.943592] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.943592] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.943735] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.944146] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.944146] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.944146] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('397559b2-3c5a-424d-b09d-43a25d2abba6',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.022689] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 12570d95-0a4a-4579-82c8-53ecf65f714e in Status: SUCCESS [ 1061.022689] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-12570d95-0a4a-4579-82c8-53ecf65f714e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.100176] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-bec5fbed-ec5a-4f98-90d3-ee0000b97d09 taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.100468] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bec5fbed-ec5a-4f98-90d3-ee0000b97d09" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.100468] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bec5fbed-ec5a-4f98-90d3-ee0000b97d09" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.100675] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bec5fbed-ec5a-4f98-90d3-ee0000b97d09" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.100846] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.100950] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.101034] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.101198] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.101769] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.101769] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bec5fbed-ec5a-4f98-90d3-ee0000b97d09" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.101769] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-bec5fbed-ec5a-4f98-90d3-ee0000b97d09 taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.101769] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bec5fbed-ec5a-4f98-90d3-ee0000b97d09" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.101769] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bec5fbed-ec5a-4f98-90d3-ee0000b97d09" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.101769] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bec5fbed-ec5a-4f98-90d3-ee0000b97d09" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.102044] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.102152] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.102152] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.102280] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.102356] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.102436] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bec5fbed-ec5a-4f98-90d3-ee0000b97d09" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.102525] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('bec5fbed-ec5a-4f98-90d3-ee0000b97d09',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.259037] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9f2518e8-b195-4520-b262-caa765ab7e27 in Status: SUCCESS [ 1061.259247] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9f2518e8-b195-4520-b262-caa765ab7e27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.259414] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9f2518e8-b195-4520-b262-caa765ab7e27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.259784] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9f2518e8-b195-4520-b262-caa765ab7e27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.260339] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.260339] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.260339] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.260339] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.260339] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.260622] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9f2518e8-b195-4520-b262-caa765ab7e27',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.446147] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.446308] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.446380] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.446594] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.446713] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.446959] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.447084] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.447150] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.447308] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.447387] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.447496] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 397559b2-3c5a-424d-b09d-43a25d2abba6 is going to be updated. [ 1061.475381] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.475534] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.475607] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.475817] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.475960] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.484085] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 397559b2-3c5a-424d-b09d-43a25d2abba6 in Status: IN_PROGRESS for 2s [ 1061.604125] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for bec5fbed-ec5a-4f98-90d3-ee0000b97d09: rpc.has_security_group_logging(os_id): False [ 1061.623993] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.624172] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.624278] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.624512] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.624607] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.624811] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.624909] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.624972] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.625198] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.625198] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.625402] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.625501] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.625582] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.625695] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.625768] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.625957] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.626063] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.626124] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.626265] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.626337] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.626437] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bec5fbed-ec5a-4f98-90d3-ee0000b97d09 is going to be updated. [ 1061.692867] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.692867] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.692867] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.692867] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.692867] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.703808] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bec5fbed-ec5a-4f98-90d3-ee0000b97d09 in Status: IN_PROGRESS for 2s [ 1061.764384] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9f2518e8-b195-4520-b262-caa765ab7e27',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.268684] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9f2518e8-b195-4520-b262-caa765ab7e27',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.603611] env[69188]: INFO networking_nsxv3.common.synchronization [req-9cfc807c-fd0b-4e40-831e-352661f890ac req-ed8095a5-3e4a-4418-9a7e-a6f074bfb70a tempest-AttachVolumeShelveTestJSON-383073810 tempest-AttachVolumeShelveTestJSON-383073810-project-member] Enqueued Resource ID: 4c598260-71fe-43f5-ab89-63a95724ea23 with Priority: HIGHEST for action security_group_members [ 1062.604153] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4c598260-71fe-43f5-ab89-63a95724ea23 with Priority: HIGHEST for action security_group_members [ 1062.604446] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-4c598260-71fe-43f5-ab89-63a95724ea23 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.607663] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4c598260-71fe-43f5-ab89-63a95724ea23" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.607663] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4c598260-71fe-43f5-ab89-63a95724ea23" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.607663] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4c598260-71fe-43f5-ab89-63a95724ea23" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.607663] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.607663] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.607663] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.607663] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.607663] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.607663] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4c598260-71fe-43f5-ab89-63a95724ea23',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.770843] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.770997] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.771081] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.771296] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.771392] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.771515] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9f2518e8-b195-4520-b262-caa765ab7e27 is going to be updated. [ 1062.805024] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.805024] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.805024] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.805024] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.805024] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.813660] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9f2518e8-b195-4520-b262-caa765ab7e27 in Status: IN_PROGRESS for 2s [ 1063.045784] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock network-796 taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.046012] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "network-796" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.046146] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "network-796" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.046535] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "network-796" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.046837] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.046957] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.047125] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.047347] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.047503] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.047712] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1063.047834] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] NeedRegenerationException {{(pid=69188) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1063.047946] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] no value, waiting for create lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1063.048076] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] value creation lock acquired {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1063.048192] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1063.048300] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Calling creation function for not-yet-present value {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1063.048435] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1063.064827] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1063.065046] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=69188) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1063.065924] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Released creation lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1063.065924] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "network-796" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.065924] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock port-a8f58709-40a0-44a2-9fc9-0e6c1122580b taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.065924] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "port-a8f58709-40a0-44a2-9fc9-0e6c1122580b" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.066136] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "port-a8f58709-40a0-44a2-9fc9-0e6c1122580b" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.066317] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "port-a8f58709-40a0-44a2-9fc9-0e6c1122580b" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.066462] env[69188]: DEBUG networking_nsxv3.api.rpc [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a8f58709-40a0-44a2-9fc9-0e6c1122580b',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1063.108062] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.108289] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.108364] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.108586] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.108678] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.108884] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.108984] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.109057] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.109206] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.109282] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.109371] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4c598260-71fe-43f5-ab89-63a95724ea23 already deleted. [ 1063.109450] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4c598260-71fe-43f5-ab89-63a95724ea23" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.494489] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 397559b2-3c5a-424d-b09d-43a25d2abba6 in Status: SUCCESS [ 1063.494792] env[69188]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 397559b2-3c5a-424d-b09d-43a25d2abba6 deletion is rescheduled due to dependency. [ 1063.494792] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-397559b2-3c5a-424d-b09d-43a25d2abba6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.572024] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.572024] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.572024] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.572024] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.572024] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.572024] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Segment Port a8f58709-40a0-44a2-9fc9-0e6c1122580b not found, creating... [ 1063.572024] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.572024] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.572024] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.572602] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.572865] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.573309] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.573622] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.573836] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.574169] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.574410] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.574660] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Resource: SegmentPort with ID: a8f58709-40a0-44a2-9fc9-0e6c1122580b is going to be created. [ 1063.596666] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.596666] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.596666] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.596666] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.596666] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.596666] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "port-a8f58709-40a0-44a2-9fc9-0e6c1122580b" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.719656] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bec5fbed-ec5a-4f98-90d3-ee0000b97d09 in Status: SUCCESS [ 1063.719953] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bec5fbed-ec5a-4f98-90d3-ee0000b97d09" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.161039] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.161039] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.161039] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.161039] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.161039] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.306295] env[69188]: INFO networking_nsxv3.common.synchronization [req-9cfc807c-fd0b-4e40-831e-352661f890ac req-21f637ca-9575-461c-aacd-95c2fec4250f service nova] Enqueued Resource ID: 4c598260-71fe-43f5-ab89-63a95724ea23 with Priority: HIGHEST for action security_group_rules [ 1064.306486] env[69188]: INFO networking_nsxv3.common.synchronization [req-9cfc807c-fd0b-4e40-831e-352661f890ac req-21f637ca-9575-461c-aacd-95c2fec4250f service nova] Enqueued Resource ID: 4c598260-71fe-43f5-ab89-63a95724ea23 with Priority: HIGHEST for action security_group_members [ 1064.306657] env[69188]: INFO networking_nsxv3.common.synchronization [req-9cfc807c-fd0b-4e40-831e-352661f890ac req-21f637ca-9575-461c-aacd-95c2fec4250f service nova] Enqueued Resource ID: a8f58709-40a0-44a2-9fc9-0e6c1122580b with Priority: HIGHEST for action port [ 1064.306969] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4c598260-71fe-43f5-ab89-63a95724ea23 with Priority: HIGHEST for action security_group_rules [ 1064.307078] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4c598260-71fe-43f5-ab89-63a95724ea23 with Priority: HIGHEST for action security_group_members [ 1064.307154] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a8f58709-40a0-44a2-9fc9-0e6c1122580b with Priority: HIGHEST for action port [ 1064.307690] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4c598260-71fe-43f5-ab89-63a95724ea23 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.307815] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4c598260-71fe-43f5-ab89-63a95724ea23" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.307920] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4c598260-71fe-43f5-ab89-63a95724ea23" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.309162] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4c598260-71fe-43f5-ab89-63a95724ea23" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.309304] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4c598260-71fe-43f5-ab89-63a95724ea23',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.310979] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-4c598260-71fe-43f5-ab89-63a95724ea23 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.311292] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4c598260-71fe-43f5-ab89-63a95724ea23" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.311409] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4c598260-71fe-43f5-ab89-63a95724ea23" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.311678] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4c598260-71fe-43f5-ab89-63a95724ea23" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.311917] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.312095] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.312204] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.312677] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.312677] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.312740] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4c598260-71fe-43f5-ab89-63a95724ea23',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.314964] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-a8f58709-40a0-44a2-9fc9-0e6c1122580b taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.315212] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a8f58709-40a0-44a2-9fc9-0e6c1122580b" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.315332] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a8f58709-40a0-44a2-9fc9-0e6c1122580b" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.315731] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a8f58709-40a0-44a2-9fc9-0e6c1122580b" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.315846] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a8f58709-40a0-44a2-9fc9-0e6c1122580b',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.663377] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.811852] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-4c598260-71fe-43f5-ab89-63a95724ea23 taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.812188] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4c598260-71fe-43f5-ab89-63a95724ea23" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.815636] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4c598260-71fe-43f5-ab89-63a95724ea23',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.818090] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a8f58709-40a0-44a2-9fc9-0e6c1122580b with status ACTIVE [ 1064.818278] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.818427] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.818481] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.818736] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.818736] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.818909] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.819062] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.819113] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.819232] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.819346] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.819481] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.819639] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.819693] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.819847] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.819986] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.820044] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a8f58709-40a0-44a2-9fc9-0e6c1122580b is going to be updated. [ 1064.826873] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9f2518e8-b195-4520-b262-caa765ab7e27 in Status: SUCCESS [ 1064.826979] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9f2518e8-b195-4520-b262-caa765ab7e27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.827494] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9f2518e8-b195-4520-b262-caa765ab7e27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.827732] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9f2518e8-b195-4520-b262-caa765ab7e27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.827917] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.828041] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.828107] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.828257] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.828338] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.828423] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9f2518e8-b195-4520-b262-caa765ab7e27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.828569] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9f2518e8-b195-4520-b262-caa765ab7e27',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.837825] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.837825] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.837969] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.838128] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.838304] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.838498] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a8f58709-40a0-44a2-9fc9-0e6c1122580b" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.012033] env[69188]: INFO networking_nsxv3.common.synchronization [req-f1f092db-6289-4b2a-9e69-0771c1055066 req-3e5eb03a-6d82-453e-8e8c-c1c0410abac5 tempest-ImagesTestJSON-2034330654 tempest-ImagesTestJSON-2034330654-project-member] Enqueued Resource ID: 199db626-eef5-4a20-b92a-585841c1cff4 with Priority: HIGHEST for action security_group_members [ 1065.012141] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 199db626-eef5-4a20-b92a-585841c1cff4 with Priority: HIGHEST for action security_group_members [ 1065.012558] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-199db626-eef5-4a20-b92a-585841c1cff4 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.012690] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-199db626-eef5-4a20-b92a-585841c1cff4" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.012751] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-199db626-eef5-4a20-b92a-585841c1cff4" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.012950] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-199db626-eef5-4a20-b92a-585841c1cff4" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.013110] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.013202] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.013261] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.013405] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.013477] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.015325] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('199db626-eef5-4a20-b92a-585841c1cff4',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1065.169474] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1065.299970] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock network-410 taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.300764] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "network-410" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.300764] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "network-410" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.300764] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "network-410" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.300934] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.301435] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.301435] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.301435] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.301639] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.301816] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1065.301937] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] NeedRegenerationException {{(pid=69188) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1065.302069] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] no value, waiting for create lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1065.302183] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] value creation lock acquired {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1065.302346] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1065.302403] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Calling creation function for not-yet-present value {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1065.302532] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1065.318030] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4c598260-71fe-43f5-ab89-63a95724ea23',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1065.321325] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1065.321325] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69188) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1065.321325] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Released creation lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1065.321325] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "network-410" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.321325] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock port-3a913829-a415-4747-afb4-9b6f3e917964 taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.321325] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "port-3a913829-a415-4747-afb4-9b6f3e917964" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.321325] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "port-3a913829-a415-4747-afb4-9b6f3e917964" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.321824] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "port-3a913829-a415-4747-afb4-9b6f3e917964" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.321824] env[69188]: DEBUG networking_nsxv3.api.rpc [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3a913829-a415-4747-afb4-9b6f3e917964',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1065.333753] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-9f2518e8-b195-4520-b262-caa765ab7e27 taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.333753] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9f2518e8-b195-4520-b262-caa765ab7e27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.333753] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9f2518e8-b195-4520-b262-caa765ab7e27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.333753] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9f2518e8-b195-4520-b262-caa765ab7e27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.333753] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.333753] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.333753] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.333753] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.333753] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.333753] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9f2518e8-b195-4520-b262-caa765ab7e27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.333753] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-9f2518e8-b195-4520-b262-caa765ab7e27 taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.333753] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9f2518e8-b195-4520-b262-caa765ab7e27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.333753] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9f2518e8-b195-4520-b262-caa765ab7e27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.333753] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9f2518e8-b195-4520-b262-caa765ab7e27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.333753] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.333753] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.334358] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.334358] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.334358] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.334358] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9f2518e8-b195-4520-b262-caa765ab7e27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.334358] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9f2518e8-b195-4520-b262-caa765ab7e27',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1065.517042] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.517042] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.517042] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.517042] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.517042] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.517042] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.517310] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.517310] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.517432] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.517515] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.517633] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 199db626-eef5-4a20-b92a-585841c1cff4 is going to be updated. [ 1065.541194] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.541329] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.541409] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.541583] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.541727] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.549191] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 199db626-eef5-4a20-b92a-585841c1cff4 in Status: IN_PROGRESS for 2s [ 1065.672226] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1065.672527] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1065.820626] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.820817] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.820901] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.821132] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.821236] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.821391] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4c598260-71fe-43f5-ab89-63a95724ea23 is going to be created. [ 1065.823684] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.823906] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.824030] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.824316] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.824476] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.824643] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Segment Port 3a913829-a415-4747-afb4-9b6f3e917964 not found, creating... [ 1065.824929] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.825114] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.825275] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.825515] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.825773] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.825990] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.826184] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.826342] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.826531] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.826709] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.826834] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Resource: SegmentPort with ID: 3a913829-a415-4747-afb4-9b6f3e917964 is going to be created. [ 1065.835465] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9f2518e8-b195-4520-b262-caa765ab7e27: rpc.has_security_group_logging(os_id): False [ 1065.865971] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.866189] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.866189] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.866381] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.866592] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.868514] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.868704] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.868831] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.869089] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.869308] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.869523] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "port-3a913829-a415-4747-afb4-9b6f3e917964" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.871538] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.871680] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.871774] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.871936] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.872047] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.872231] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.872329] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.872393] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.872540] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.872617] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.872799] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.872891] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.872948] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.873103] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.873273] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.873370] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.873455] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.873509] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.873666] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.873742] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.873826] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9f2518e8-b195-4520-b262-caa765ab7e27 is going to be updated. [ 1065.883405] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4c598260-71fe-43f5-ab89-63a95724ea23 in Status: UNINITIALIZED for 2s [ 1065.966346] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.966527] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.966527] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.966748] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.966855] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.996403] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9f2518e8-b195-4520-b262-caa765ab7e27 in Status: IN_PROGRESS for 2s [ 1066.575363] env[69188]: INFO networking_nsxv3.common.synchronization [req-f1f092db-6289-4b2a-9e69-0771c1055066 req-baba8f1a-e944-40c2-8d03-c1616a550d4a service nova] Enqueued Resource ID: 199db626-eef5-4a20-b92a-585841c1cff4 with Priority: HIGHEST for action security_group_rules [ 1066.575363] env[69188]: INFO networking_nsxv3.common.synchronization [req-f1f092db-6289-4b2a-9e69-0771c1055066 req-baba8f1a-e944-40c2-8d03-c1616a550d4a service nova] Enqueued Resource ID: 199db626-eef5-4a20-b92a-585841c1cff4 with Priority: HIGHEST for action security_group_members [ 1066.575363] env[69188]: INFO networking_nsxv3.common.synchronization [req-f1f092db-6289-4b2a-9e69-0771c1055066 req-baba8f1a-e944-40c2-8d03-c1616a550d4a service nova] Enqueued Resource ID: 3a913829-a415-4747-afb4-9b6f3e917964 with Priority: HIGHEST for action port [ 1066.575363] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 199db626-eef5-4a20-b92a-585841c1cff4 with Priority: HIGHEST for action security_group_rules [ 1066.575363] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 199db626-eef5-4a20-b92a-585841c1cff4 with Priority: HIGHEST for action security_group_members [ 1066.575363] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3a913829-a415-4747-afb4-9b6f3e917964 with Priority: HIGHEST for action port [ 1066.575363] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-199db626-eef5-4a20-b92a-585841c1cff4 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.575363] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-199db626-eef5-4a20-b92a-585841c1cff4" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.575363] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-199db626-eef5-4a20-b92a-585841c1cff4" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.575363] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-199db626-eef5-4a20-b92a-585841c1cff4" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.575814] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('199db626-eef5-4a20-b92a-585841c1cff4',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.577291] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-199db626-eef5-4a20-b92a-585841c1cff4 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.577519] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-199db626-eef5-4a20-b92a-585841c1cff4" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.577817] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-3a913829-a415-4747-afb4-9b6f3e917964 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.578060] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3a913829-a415-4747-afb4-9b6f3e917964" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.578201] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3a913829-a415-4747-afb4-9b6f3e917964" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.578439] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3a913829-a415-4747-afb4-9b6f3e917964" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.578593] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3a913829-a415-4747-afb4-9b6f3e917964',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.663136] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.663136] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.663136] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.663482] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.676642] env[69188]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1066.677531] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.678450] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1066.709683] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.709818] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.709890] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.710117] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.720810] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.721459] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:1. [ 1066.721543] env[69188]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:{'a8f58709-40a0-44a2-9fc9-0e6c1122580b'} {{(pid=69188) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1066.721636] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1066.800435] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.800629] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.800629] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.800956] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.802435] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.802682] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1066.892815] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.892988] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.893063] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.893259] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.893548] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.894366] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1066.976575] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.977091] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.977273] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.977541] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.977870] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.978202] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:44. [ 1066.978331] env[69188]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'43255fe7-9062-49a0-a8ff-2aab46177272', 'a1ea10ba-bdd7-49b6-97a8-01622e70af27', '345a1564-5c47-4d81-9096-66a6ad96570a', '2dad819d-4da9-4798-827e-298c399b35c5', 'd7156740-676b-417b-9850-f10d741c20bd', '199db626-eef5-4a20-b92a-585841c1cff4', '397559b2-3c5a-424d-b09d-43a25d2abba6', '725df672-6688-4714-8676-49fbb42ed7bd', 'e6233127-d754-46c4-9840-1e77714a63d1', 'ec45d27b-caa2-4488-8317-d6595de404b8', '8f01fd17-613c-4bd7-9c6b-8b39ac58be72', '6551850f-c3f5-470f-b5eb-f7d542ab3a90', 'e3296f55-96ac-44eb-a498-8c6ab147c5ab', 'fa6e8a6e-b63b-4248-b67b-4ae889fac90c', 'abb7f382-0834-4984-98c9-82d36651f452', '7f98bc00-dbd3-411c-a67a-14369145489a', '948c6e1f-1c67-4d7c-bf02-0ca6a7c3cbda', '12570d95-0a4a-4579-82c8-53ecf65f714e', '166e7c17-8917-425e-9cd8-0580f8aa3e74', '9f2518e8-b195-4520-b262-caa765ab7e27', '143fbb10-efe2-4f17-a012-d41cc9b595b6', 'cd207b0a-02a6-4378-9240-c9d49160b653', '938f39e5-b2c4-4a5d-b8ea-03c277953ec9', '53a4d3c3-01ca-4828-94d1-6fa305c27650', '048d5e2e-adfe-4bc0-9ae5-f6d99d633e62', 'c019210a-f261-4200-a6cd-a6e2fc4f9396', '86b3e666-35a3-418a-82c9-eb305c030ea1', '5e76d42e-7ec6-4a5e-aa9c-c5a285d62318', 'bec5fbed-ec5a-4f98-90d3-ee0000b97d09', '9482bec7-7d68-4fe1-8d77-d380c3f6dc7a', '460ab751-c0ea-45e9-bf76-9a767798212b', '5f183b9d-5066-4eee-a079-2adf3a1d0f7c', '870d4230-10cb-4ebd-8d12-34aaae29ea98', '867581e0-cbbd-4108-a823-0b7c53d47c3a', '53b2b927-2e3d-4111-b25a-7b34ab9fa28d', '55dcb887-f0db-4969-b757-e829798327eb', 'dbff1afa-14ec-4fad-8985-0fb6140d58bb', '9d153fe4-605f-47fe-a33b-9d019b977fa7', '721e26e3-d896-46ab-b5a3-92852a365813', 'b99e414b-ff9c-4d19-b3c8-32ab58288d75', '4e9db3bb-e903-42d7-b7e6-e365ea0c7f5f', '614b9fd7-ab13-4673-ace1-c5f03c5b9acc', '24a7b083-b432-46d6-94de-76adf6ce22b3', 'e275bda6-f504-45ea-9805-84ac49a67aa7'} {{(pid=69188) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1066.978416] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1066.999399] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.999591] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.000212] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.000457] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.000583] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.000742] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1067.000843] env[69188]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=69188) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1067.000946] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1067.076014] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.076014] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.076014] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.076207] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.077019] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.077632] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1067.077760] env[69188]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=69188) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1067.077850] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1067.077921] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 1/1 resources of Type:Ports [ 1067.078026] env[69188]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a8f58709-40a0-44a2-9fc9-0e6c1122580b with Priority: HIGH for action port [ 1067.078128] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 19/44 resources of Type:Security Group Rules [ 1067.078194] env[69188]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 43255fe7-9062-49a0-a8ff-2aab46177272 with Priority: HIGH for action security_group_rules [ 1067.078262] env[69188]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a1ea10ba-bdd7-49b6-97a8-01622e70af27 with Priority: HIGH for action security_group_rules [ 1067.078326] env[69188]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 345a1564-5c47-4d81-9096-66a6ad96570a with Priority: HIGH for action security_group_rules [ 1067.078389] env[69188]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 2dad819d-4da9-4798-827e-298c399b35c5 with Priority: HIGH for action security_group_rules [ 1067.078450] env[69188]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d7156740-676b-417b-9850-f10d741c20bd with Priority: HIGH for action security_group_rules [ 1067.078511] env[69188]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 199db626-eef5-4a20-b92a-585841c1cff4 with Priority: HIGH for action security_group_rules [ 1067.078571] env[69188]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 397559b2-3c5a-424d-b09d-43a25d2abba6 with Priority: HIGH for action security_group_rules [ 1067.078633] env[69188]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 725df672-6688-4714-8676-49fbb42ed7bd with Priority: HIGH for action security_group_rules [ 1067.078696] env[69188]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e6233127-d754-46c4-9840-1e77714a63d1 with Priority: HIGH for action security_group_rules [ 1067.078756] env[69188]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ec45d27b-caa2-4488-8317-d6595de404b8 with Priority: HIGH for action security_group_rules [ 1067.078830] env[69188]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 8f01fd17-613c-4bd7-9c6b-8b39ac58be72 with Priority: HIGH for action security_group_rules [ 1067.078892] env[69188]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 6551850f-c3f5-470f-b5eb-f7d542ab3a90 with Priority: HIGH for action security_group_rules [ 1067.078953] env[69188]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e3296f55-96ac-44eb-a498-8c6ab147c5ab with Priority: HIGH for action security_group_rules [ 1067.079039] env[69188]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: fa6e8a6e-b63b-4248-b67b-4ae889fac90c with Priority: HIGH for action security_group_rules [ 1067.079077] env[69188]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: abb7f382-0834-4984-98c9-82d36651f452 with Priority: HIGH for action security_group_rules [ 1067.079141] env[69188]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7f98bc00-dbd3-411c-a67a-14369145489a with Priority: HIGH for action security_group_rules [ 1067.079202] env[69188]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 948c6e1f-1c67-4d7c-bf02-0ca6a7c3cbda with Priority: HIGH for action security_group_rules [ 1067.079265] env[69188]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 12570d95-0a4a-4579-82c8-53ecf65f714e with Priority: HIGH for action security_group_rules [ 1067.079336] env[69188]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 166e7c17-8917-425e-9cd8-0580f8aa3e74 with Priority: HIGH for action security_group_rules [ 1067.079434] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.079831] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-199db626-eef5-4a20-b92a-585841c1cff4 taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.079916] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-199db626-eef5-4a20-b92a-585841c1cff4" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.080103] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3a913829-a415-4747-afb4-9b6f3e917964 with status ACTIVE [ 1067.080252] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.080348] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.080409] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.080577] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.081067] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.081239] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.081334] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.081393] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.081536] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.081610] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.081782] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.081873] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.081992] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.082486] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.082567] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.082650] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3a913829-a415-4747-afb4-9b6f3e917964 is going to be updated. [ 1067.106699] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.106840] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.106910] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.107121] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.107251] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.107407] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3a913829-a415-4747-afb4-9b6f3e917964" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.355401] env[69188]: INFO networking_nsxv3.common.synchronization [req-4789df69-5e49-40a8-bce8-e750694cc29d req-ecaf60a9-b340-43f0-a21e-4f1249098f1d tempest-AttachInterfacesTestJSON-1255877948 tempest-AttachInterfacesTestJSON-1255877948-project-member] Enqueued Resource ID: 12570d95-0a4a-4579-82c8-53ecf65f714e with Priority: HIGHEST for action security_group_members [ 1067.356293] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 12570d95-0a4a-4579-82c8-53ecf65f714e with Priority: HIGHEST for action security_group_members [ 1067.356293] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a8f58709-40a0-44a2-9fc9-0e6c1122580b with Priority: HIGH for action port [ 1067.356293] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a1ea10ba-bdd7-49b6-97a8-01622e70af27 with Priority: HIGH for action security_group_rules [ 1067.356293] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 199db626-eef5-4a20-b92a-585841c1cff4 with Priority: HIGH for action security_group_rules [ 1067.356293] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fa6e8a6e-b63b-4248-b67b-4ae889fac90c with Priority: HIGH for action security_group_rules [ 1067.356293] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 166e7c17-8917-425e-9cd8-0580f8aa3e74 with Priority: HIGH for action security_group_rules [ 1067.356293] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 12570d95-0a4a-4579-82c8-53ecf65f714e with Priority: HIGH for action security_group_rules [ 1067.356561] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 948c6e1f-1c67-4d7c-bf02-0ca6a7c3cbda with Priority: HIGH for action security_group_rules [ 1067.356561] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f98bc00-dbd3-411c-a67a-14369145489a with Priority: HIGH for action security_group_rules [ 1067.356561] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e3296f55-96ac-44eb-a498-8c6ab147c5ab with Priority: HIGH for action security_group_rules [ 1067.356648] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: abb7f382-0834-4984-98c9-82d36651f452 with Priority: HIGH for action security_group_rules [ 1067.356699] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6551850f-c3f5-470f-b5eb-f7d542ab3a90 with Priority: HIGH for action security_group_rules [ 1067.356780] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f01fd17-613c-4bd7-9c6b-8b39ac58be72 with Priority: HIGH for action security_group_rules [ 1067.356868] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ec45d27b-caa2-4488-8317-d6595de404b8 with Priority: HIGH for action security_group_rules [ 1067.356953] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e6233127-d754-46c4-9840-1e77714a63d1 with Priority: HIGH for action security_group_rules [ 1067.358458] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 725df672-6688-4714-8676-49fbb42ed7bd with Priority: HIGH for action security_group_rules [ 1067.358606] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d7156740-676b-417b-9850-f10d741c20bd with Priority: HIGH for action security_group_rules [ 1067.358713] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 397559b2-3c5a-424d-b09d-43a25d2abba6 with Priority: HIGH for action security_group_rules [ 1067.358814] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2dad819d-4da9-4798-827e-298c399b35c5 with Priority: HIGH for action security_group_rules [ 1067.358909] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 43255fe7-9062-49a0-a8ff-2aab46177272 with Priority: HIGH for action security_group_rules [ 1067.359009] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 345a1564-5c47-4d81-9096-66a6ad96570a with Priority: HIGH for action security_group_rules [ 1067.359313] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-12570d95-0a4a-4579-82c8-53ecf65f714e taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.359435] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-12570d95-0a4a-4579-82c8-53ecf65f714e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.359532] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-12570d95-0a4a-4579-82c8-53ecf65f714e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.359775] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-12570d95-0a4a-4579-82c8-53ecf65f714e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.359972] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.360032] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.360092] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.360242] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.360781] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.360890] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('12570d95-0a4a-4579-82c8-53ecf65f714e',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.362237] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-a8f58709-40a0-44a2-9fc9-0e6c1122580b taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.362690] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a8f58709-40a0-44a2-9fc9-0e6c1122580b" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.362690] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a8f58709-40a0-44a2-9fc9-0e6c1122580b" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.362690] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a8f58709-40a0-44a2-9fc9-0e6c1122580b" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.362810] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a8f58709-40a0-44a2-9fc9-0e6c1122580b',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.364717] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a1ea10ba-bdd7-49b6-97a8-01622e70af27 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.364717] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a1ea10ba-bdd7-49b6-97a8-01622e70af27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.364717] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a1ea10ba-bdd7-49b6-97a8-01622e70af27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.364717] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a1ea10ba-bdd7-49b6-97a8-01622e70af27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.364717] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a1ea10ba-bdd7-49b6-97a8-01622e70af27',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.365875] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-199db626-eef5-4a20-b92a-585841c1cff4 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.365956] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-199db626-eef5-4a20-b92a-585841c1cff4" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.366265] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fa6e8a6e-b63b-4248-b67b-4ae889fac90c taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.366265] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fa6e8a6e-b63b-4248-b67b-4ae889fac90c" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.366354] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fa6e8a6e-b63b-4248-b67b-4ae889fac90c" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.366446] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fa6e8a6e-b63b-4248-b67b-4ae889fac90c" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.366517] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fa6e8a6e-b63b-4248-b67b-4ae889fac90c',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.367480] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-166e7c17-8917-425e-9cd8-0580f8aa3e74 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.367593] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-166e7c17-8917-425e-9cd8-0580f8aa3e74" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.367660] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-166e7c17-8917-425e-9cd8-0580f8aa3e74" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.367810] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-166e7c17-8917-425e-9cd8-0580f8aa3e74" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.367879] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('166e7c17-8917-425e-9cd8-0580f8aa3e74',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.370288] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-12570d95-0a4a-4579-82c8-53ecf65f714e taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.370288] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-12570d95-0a4a-4579-82c8-53ecf65f714e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.370401] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-12570d95-0a4a-4579-82c8-53ecf65f714e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.370483] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-12570d95-0a4a-4579-82c8-53ecf65f714e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.370546] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('12570d95-0a4a-4579-82c8-53ecf65f714e',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.371236] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-948c6e1f-1c67-4d7c-bf02-0ca6a7c3cbda taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.371344] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-948c6e1f-1c67-4d7c-bf02-0ca6a7c3cbda" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.371411] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-948c6e1f-1c67-4d7c-bf02-0ca6a7c3cbda" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.371565] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-948c6e1f-1c67-4d7c-bf02-0ca6a7c3cbda" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.372043] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('948c6e1f-1c67-4d7c-bf02-0ca6a7c3cbda',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.373827] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7f98bc00-dbd3-411c-a67a-14369145489a taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.375145] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7f98bc00-dbd3-411c-a67a-14369145489a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.375145] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7f98bc00-dbd3-411c-a67a-14369145489a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.375145] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7f98bc00-dbd3-411c-a67a-14369145489a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.375145] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7f98bc00-dbd3-411c-a67a-14369145489a',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.375515] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e3296f55-96ac-44eb-a498-8c6ab147c5ab taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.375738] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e3296f55-96ac-44eb-a498-8c6ab147c5ab" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.375886] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e3296f55-96ac-44eb-a498-8c6ab147c5ab" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.378020] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e3296f55-96ac-44eb-a498-8c6ab147c5ab" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.378020] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e3296f55-96ac-44eb-a498-8c6ab147c5ab',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.378020] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-abb7f382-0834-4984-98c9-82d36651f452 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.378020] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-abb7f382-0834-4984-98c9-82d36651f452" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.378020] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-abb7f382-0834-4984-98c9-82d36651f452" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.378020] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-abb7f382-0834-4984-98c9-82d36651f452" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.378020] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('abb7f382-0834-4984-98c9-82d36651f452',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.380015] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6551850f-c3f5-470f-b5eb-f7d542ab3a90 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.380015] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6551850f-c3f5-470f-b5eb-f7d542ab3a90" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.380015] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6551850f-c3f5-470f-b5eb-f7d542ab3a90" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.380270] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6551850f-c3f5-470f-b5eb-f7d542ab3a90" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.380326] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6551850f-c3f5-470f-b5eb-f7d542ab3a90',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.381047] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8f01fd17-613c-4bd7-9c6b-8b39ac58be72 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.381191] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8f01fd17-613c-4bd7-9c6b-8b39ac58be72" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.381222] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8f01fd17-613c-4bd7-9c6b-8b39ac58be72" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.381368] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8f01fd17-613c-4bd7-9c6b-8b39ac58be72" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.381441] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8f01fd17-613c-4bd7-9c6b-8b39ac58be72',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.382129] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ec45d27b-caa2-4488-8317-d6595de404b8 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.382456] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ec45d27b-caa2-4488-8317-d6595de404b8" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.382456] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ec45d27b-caa2-4488-8317-d6595de404b8" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.382456] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ec45d27b-caa2-4488-8317-d6595de404b8" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.382540] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ec45d27b-caa2-4488-8317-d6595de404b8',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.383409] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e6233127-d754-46c4-9840-1e77714a63d1 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.383482] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e6233127-d754-46c4-9840-1e77714a63d1" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.383549] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e6233127-d754-46c4-9840-1e77714a63d1" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.383702] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e6233127-d754-46c4-9840-1e77714a63d1" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.383776] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e6233127-d754-46c4-9840-1e77714a63d1',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.385142] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-725df672-6688-4714-8676-49fbb42ed7bd taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.385225] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-725df672-6688-4714-8676-49fbb42ed7bd" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.385269] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-725df672-6688-4714-8676-49fbb42ed7bd" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.385643] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-725df672-6688-4714-8676-49fbb42ed7bd" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.385643] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('725df672-6688-4714-8676-49fbb42ed7bd',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.388995] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d7156740-676b-417b-9850-f10d741c20bd taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.388995] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d7156740-676b-417b-9850-f10d741c20bd" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.388995] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d7156740-676b-417b-9850-f10d741c20bd" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.388995] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d7156740-676b-417b-9850-f10d741c20bd" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.388995] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d7156740-676b-417b-9850-f10d741c20bd',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.389467] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-397559b2-3c5a-424d-b09d-43a25d2abba6 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.389467] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-397559b2-3c5a-424d-b09d-43a25d2abba6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.389467] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-397559b2-3c5a-424d-b09d-43a25d2abba6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.389613] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-397559b2-3c5a-424d-b09d-43a25d2abba6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.389736] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('397559b2-3c5a-424d-b09d-43a25d2abba6',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.390409] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2dad819d-4da9-4798-827e-298c399b35c5 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.390517] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2dad819d-4da9-4798-827e-298c399b35c5" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.390584] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2dad819d-4da9-4798-827e-298c399b35c5" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.390777] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2dad819d-4da9-4798-827e-298c399b35c5" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.390856] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2dad819d-4da9-4798-827e-298c399b35c5',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.391523] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-43255fe7-9062-49a0-a8ff-2aab46177272 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.391628] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-43255fe7-9062-49a0-a8ff-2aab46177272" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.391695] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-43255fe7-9062-49a0-a8ff-2aab46177272" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.391876] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-43255fe7-9062-49a0-a8ff-2aab46177272" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.391911] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('43255fe7-9062-49a0-a8ff-2aab46177272',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.392580] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-345a1564-5c47-4d81-9096-66a6ad96570a taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.393014] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-345a1564-5c47-4d81-9096-66a6ad96570a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.393014] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-345a1564-5c47-4d81-9096-66a6ad96570a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.393014] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-345a1564-5c47-4d81-9096-66a6ad96570a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.393014] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('345a1564-5c47-4d81-9096-66a6ad96570a',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.418253] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.418427] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.418464] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.418687] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.450552] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.450669] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7f98bc00-dbd3-411c-a67a-14369145489a is going to be deleted. [ 1067.515712] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.515712] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.515712] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.515712] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.515712] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.515712] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7f98bc00-dbd3-411c-a67a-14369145489a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.560629] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 199db626-eef5-4a20-b92a-585841c1cff4 in Status: SUCCESS [ 1067.560629] env[69188]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 199db626-eef5-4a20-b92a-585841c1cff4 deletion is rescheduled due to dependency. [ 1067.560629] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-199db626-eef5-4a20-b92a-585841c1cff4" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.560629] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-199db626-eef5-4a20-b92a-585841c1cff4" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.560629] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-199db626-eef5-4a20-b92a-585841c1cff4" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.560629] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.560629] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.560629] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.560629] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.560629] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.560629] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('199db626-eef5-4a20-b92a-585841c1cff4',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.580647] env[69188]: INFO networking_nsxv3.common.synchronization [req-0ab5cce6-3988-4e8c-b791-74ee509358f8 req-ebd32726-3686-4d82-967b-756fa7a4943f tempest-ServersNegativeTestJSON-5747953 tempest-ServersNegativeTestJSON-5747953-project-member] Enqueued Resource ID: 938f39e5-b2c4-4a5d-b8ea-03c277953ec9 with Priority: HIGHEST for action security_group_members [ 1067.580735] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 938f39e5-b2c4-4a5d-b8ea-03c277953ec9 with Priority: HIGHEST for action security_group_members [ 1067.581193] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-938f39e5-b2c4-4a5d-b8ea-03c277953ec9 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.581345] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-938f39e5-b2c4-4a5d-b8ea-03c277953ec9" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.581417] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-938f39e5-b2c4-4a5d-b8ea-03c277953ec9" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.581607] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-938f39e5-b2c4-4a5d-b8ea-03c277953ec9" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.581760] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.581857] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.581920] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.582074] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.582159] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.582251] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('938f39e5-b2c4-4a5d-b8ea-03c277953ec9',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.863882] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.863882] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.863882] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.863882] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.865389] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a8f58709-40a0-44a2-9fc9-0e6c1122580b with status ACTIVE [ 1067.865389] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.865389] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.865389] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.865582] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.865681] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.865860] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.865967] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.866060] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.866236] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.866310] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.866525] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.866624] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.866686] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.866998] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.866998] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.866998] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a8f58709-40a0-44a2-9fc9-0e6c1122580b is going to be updated. [ 1067.868904] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-fa6e8a6e-b63b-4248-b67b-4ae889fac90c taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.869064] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fa6e8a6e-b63b-4248-b67b-4ae889fac90c" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.869174] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fa6e8a6e-b63b-4248-b67b-4ae889fac90c" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.869345] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fa6e8a6e-b63b-4248-b67b-4ae889fac90c" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.869502] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.869615] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.869724] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.869864] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.869975] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.870098] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fa6e8a6e-b63b-4248-b67b-4ae889fac90c" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.870190] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fa6e8a6e-b63b-4248-b67b-4ae889fac90c',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.894280] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.894560] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.895847] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-e3296f55-96ac-44eb-a498-8c6ab147c5ab taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.896010] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e3296f55-96ac-44eb-a498-8c6ab147c5ab" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.896083] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e3296f55-96ac-44eb-a498-8c6ab147c5ab" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.896251] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e3296f55-96ac-44eb-a498-8c6ab147c5ab" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.896407] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.896497] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.896557] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.896703] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.896789] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.897317] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e3296f55-96ac-44eb-a498-8c6ab147c5ab" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.897317] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e3296f55-96ac-44eb-a498-8c6ab147c5ab',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.901170] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.902771] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.903238] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.904174] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.904511] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.904511] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.904639] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 12570d95-0a4a-4579-82c8-53ecf65f714e is going to be updated. [ 1067.906408] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.906549] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.906588] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.906771] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.911246] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-6551850f-c3f5-470f-b5eb-f7d542ab3a90 taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.911417] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6551850f-c3f5-470f-b5eb-f7d542ab3a90" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.911488] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6551850f-c3f5-470f-b5eb-f7d542ab3a90" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.911669] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6551850f-c3f5-470f-b5eb-f7d542ab3a90" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.911852] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.911972] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.912036] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.912186] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.912263] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.912347] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6551850f-c3f5-470f-b5eb-f7d542ab3a90" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.912429] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6551850f-c3f5-470f-b5eb-f7d542ab3a90',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.927768] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4c598260-71fe-43f5-ab89-63a95724ea23 in Status: SUCCESS [ 1067.927985] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4c598260-71fe-43f5-ab89-63a95724ea23" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.929736] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e3296f55-96ac-44eb-a498-8c6ab147c5ab',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.931463] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.931613] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.932366] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.932498] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.932552] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.932737] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.932865] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.933022] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a8f58709-40a0-44a2-9fc9-0e6c1122580b" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.938190] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4c598260-71fe-43f5-ab89-63a95724ea23" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.938408] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4c598260-71fe-43f5-ab89-63a95724ea23" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.938605] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.938738] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.938804] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.938964] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.939061] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.939147] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4c598260-71fe-43f5-ab89-63a95724ea23" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.939237] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4c598260-71fe-43f5-ab89-63a95724ea23',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.945293] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock network-22 taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.945499] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "network-22" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.945630] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "network-22" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.945887] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "network-22" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.946166] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.946325] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.946447] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.946657] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.946808] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.947018] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1067.947133] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] NeedRegenerationException {{(pid=69188) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1067.947244] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] no value, waiting for create lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1067.947354] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] value creation lock acquired {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1067.947465] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1067.947595] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Calling creation function for not-yet-present value {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1067.948222] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1067.958988] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4c598260-71fe-43f5-ab89-63a95724ea23',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.972229] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.972352] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.973918] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.974056] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 166e7c17-8917-425e-9cd8-0580f8aa3e74 is going to be deleted. [ 1067.974900] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.975128] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.976968] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.977087] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.999540] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.000264] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.000264] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.000264] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.000264] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.005023] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.005023] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.005023] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.005023] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.005023] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.005023] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.005490] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.005490] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.006196] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.006288] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.014195] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.014307] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.015936] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 12570d95-0a4a-4579-82c8-53ecf65f714e in Status: IN_PROGRESS for 2s [ 1068.016717] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.016831] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.019383] env[69188]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1068.019857] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.019949] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.023284] env[69188]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1068.023626] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9f2518e8-b195-4520-b262-caa765ab7e27 in Status: SUCCESS [ 1068.025983] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9f2518e8-b195-4520-b262-caa765ab7e27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.025983] env[69188]: WARNING urllib3.connectionpool [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1068.025983] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1068.025983] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Cache value generated in 0.078 seconds for key(s): 'zone-id' {{(pid=69188) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1068.025983] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Released creation lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1068.025983] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "network-22" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.025983] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock port-fdd614bf-27a5-4b0e-a8a4-b7087bc76b69 taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.026474] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "port-fdd614bf-27a5-4b0e-a8a4-b7087bc76b69" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.026474] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "port-fdd614bf-27a5-4b0e-a8a4-b7087bc76b69" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.026665] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "port-fdd614bf-27a5-4b0e-a8a4-b7087bc76b69" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.026708] env[69188]: DEBUG networking_nsxv3.api.rpc [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fdd614bf-27a5-4b0e-a8a4-b7087bc76b69',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.037018] env[69188]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1068.037620] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.037783] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a1ea10ba-bdd7-49b6-97a8-01622e70af27 is going to be deleted. [ 1068.038738] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.038959] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.060554] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.060730] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.063092] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('199db626-eef5-4a20-b92a-585841c1cff4',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.070082] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.070223] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.083835] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('938f39e5-b2c4-4a5d-b8ea-03c277953ec9',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.104460] env[69188]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1068.105069] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.105248] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 948c6e1f-1c67-4d7c-bf02-0ca6a7c3cbda is going to be deleted. [ 1068.106292] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.106465] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.139939] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.140152] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: abb7f382-0834-4984-98c9-82d36651f452 is going to be deleted. [ 1068.141305] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.141584] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.181432] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.181549] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d7156740-676b-417b-9850-f10d741c20bd is going to be deleted. [ 1068.182819] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.183111] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.225593] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.225803] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.228426] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.228426] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 43255fe7-9062-49a0-a8ff-2aab46177272 is going to be deleted. [ 1068.229300] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.229533] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.270156] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.270414] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.278645] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.278774] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.288511] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.288620] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 397559b2-3c5a-424d-b09d-43a25d2abba6 is going to be deleted. [ 1068.289710] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.289931] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.375078] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-fa6e8a6e-b63b-4248-b67b-4ae889fac90c taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.375246] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fa6e8a6e-b63b-4248-b67b-4ae889fac90c" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.375311] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fa6e8a6e-b63b-4248-b67b-4ae889fac90c" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.375535] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fa6e8a6e-b63b-4248-b67b-4ae889fac90c" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.375699] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.375795] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.375870] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.376040] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.376131] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.376218] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fa6e8a6e-b63b-4248-b67b-4ae889fac90c" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.376363] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-fa6e8a6e-b63b-4248-b67b-4ae889fac90c taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.376521] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fa6e8a6e-b63b-4248-b67b-4ae889fac90c" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.376597] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fa6e8a6e-b63b-4248-b67b-4ae889fac90c" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.376739] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fa6e8a6e-b63b-4248-b67b-4ae889fac90c" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.376876] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.376967] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.377039] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.377168] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.377243] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.377325] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fa6e8a6e-b63b-4248-b67b-4ae889fac90c" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.377413] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fa6e8a6e-b63b-4248-b67b-4ae889fac90c',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.424714] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6551850f-c3f5-470f-b5eb-f7d542ab3a90',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.442319] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e3296f55-96ac-44eb-a498-8c6ab147c5ab: rpc.has_security_group_logging(os_id): False [ 1068.464590] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4c598260-71fe-43f5-ab89-63a95724ea23: rpc.has_security_group_logging(os_id): False [ 1068.494370] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.494510] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2dad819d-4da9-4798-827e-298c399b35c5 is going to be deleted. [ 1068.495411] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.495917] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.512562] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.512698] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.513622] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.513723] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.529496] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.530055] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.530055] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.530478] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.530478] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.530582] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Segment Port fdd614bf-27a5-4b0e-a8a4-b7087bc76b69 not found, creating... [ 1068.530910] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.531089] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.531224] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.531486] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.531585] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.532231] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.532231] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.532231] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.532398] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.532544] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.532681] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Resource: SegmentPort with ID: fdd614bf-27a5-4b0e-a8a4-b7087bc76b69 is going to be created. [ 1068.534372] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.534470] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.536477] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.536477] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.555200] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.556174] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e6233127-d754-46c4-9840-1e77714a63d1 is going to be deleted. [ 1068.556580] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.556580] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.564579] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('199db626-eef5-4a20-b92a-585841c1cff4',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.585525] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('938f39e5-b2c4-4a5d-b8ea-03c277953ec9',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.644335] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.644451] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 725df672-6688-4714-8676-49fbb42ed7bd is going to be deleted. [ 1068.645351] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.645560] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.649724] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.649863] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.651291] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.651291] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.651291] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.651489] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.651737] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.651999] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "port-fdd614bf-27a5-4b0e-a8a4-b7087bc76b69" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.695014] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.695298] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.762422] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.762609] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ec45d27b-caa2-4488-8317-d6595de404b8 is going to be deleted. [ 1068.763631] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.763866] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.788769] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.788884] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.804652] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.804820] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.860811] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.860988] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 345a1564-5c47-4d81-9096-66a6ad96570a is going to be deleted. [ 1068.861999] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.862247] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.880196] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fa6e8a6e-b63b-4248-b67b-4ae889fac90c: rpc.has_security_group_logging(os_id): False [ 1068.927041] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6551850f-c3f5-470f-b5eb-f7d542ab3a90: rpc.has_security_group_logging(os_id): False [ 1068.929828] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.929828] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.941612] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.941819] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8f01fd17-613c-4bd7-9c6b-8b39ac58be72 is going to be deleted. [ 1068.942821] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.943060] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.943206] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.943336] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 12570d95-0a4a-4579-82c8-53ecf65f714e is going to be deleted. [ 1068.944209] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.944464] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.944590] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.944776] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-166e7c17-8917-425e-9cd8-0580f8aa3e74" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.945362] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.945611] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.945793] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.945960] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a1ea10ba-bdd7-49b6-97a8-01622e70af27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.946465] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.946689] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.946877] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.947068] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-948c6e1f-1c67-4d7c-bf02-0ca6a7c3cbda" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.947265] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.947453] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.947553] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.947690] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-abb7f382-0834-4984-98c9-82d36651f452" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.947850] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.948094] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.948214] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.948538] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.948687] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.948792] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.948985] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.949125] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.949264] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4c598260-71fe-43f5-ab89-63a95724ea23 is going to be created. [ 1068.950271] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.950452] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.961678] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.961678] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.990375] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.990796] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.999762] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.000237] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.000604] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.000844] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.002960] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.002960] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.002960] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e3296f55-96ac-44eb-a498-8c6ab147c5ab is going to be updated. [ 1069.002960] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.002960] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.002960] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.002960] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-43255fe7-9062-49a0-a8ff-2aab46177272" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.003452] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.004166] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.004166] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.004166] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-397559b2-3c5a-424d-b09d-43a25d2abba6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.008411] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.008411] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.008411] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.008411] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.008411] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.008411] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-345a1564-5c47-4d81-9096-66a6ad96570a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.008411] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.009077] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.009308] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.010016] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2dad819d-4da9-4798-827e-298c399b35c5" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.010016] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.010016] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.010250] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.010488] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e6233127-d754-46c4-9840-1e77714a63d1" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.011244] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.011574] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.012050] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.012050] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-725df672-6688-4714-8676-49fbb42ed7bd" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.012338] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.012626] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.044760] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.044760] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.068483] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.068483] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.068483] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.068483] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.068483] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.068483] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 199db626-eef5-4a20-b92a-585841c1cff4 is going to be updated. [ 1069.088299] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.088605] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.088783] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.089080] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.089341] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.089550] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 938f39e5-b2c4-4a5d-b8ea-03c277953ec9 is going to be updated. [ 1069.091830] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.093190] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.094212] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.094601] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.094878] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.095070] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.095355] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.095578] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.095878] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.097020] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.097020] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.097020] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.097020] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.097020] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.097020] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.097020] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.097020] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.100989] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.100989] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fa6e8a6e-b63b-4248-b67b-4ae889fac90c is going to be updated. [ 1069.100989] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.100989] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.117235] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.117377] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.143371] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.143720] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.143824] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.143889] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.144119] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.144208] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.144305] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6551850f-c3f5-470f-b5eb-f7d542ab3a90 is going to be updated. [ 1069.145399] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.145587] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.145673] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.145796] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ec45d27b-caa2-4488-8317-d6595de404b8" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.145939] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.146691] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.146817] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.146924] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8f01fd17-613c-4bd7-9c6b-8b39ac58be72" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.147092] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.147256] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.147424] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.148358] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.148527] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.148616] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.148728] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d7156740-676b-417b-9850-f10d741c20bd" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.149273] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.149500] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.149611] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.149767] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-12570d95-0a4a-4579-82c8-53ecf65f714e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.167051] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.167210] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.167292] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.167495] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.167637] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.169338] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.169455] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.169512] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.169729] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.169851] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.176243] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4c598260-71fe-43f5-ab89-63a95724ea23 in Status: IN_PROGRESS for 2s [ 1069.196547] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.196829] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.196829] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.196977] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.197088] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.212848] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 938f39e5-b2c4-4a5d-b8ea-03c277953ec9 in Status: IN_PROGRESS for 2s [ 1069.213551] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 199db626-eef5-4a20-b92a-585841c1cff4 in Status: IN_PROGRESS for 2s [ 1069.238021] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e3296f55-96ac-44eb-a498-8c6ab147c5ab in Status: IN_PROGRESS for 2s [ 1069.250555] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.250718] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.250802] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.251028] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.251472] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.284640] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fa6e8a6e-b63b-4248-b67b-4ae889fac90c in Status: IN_PROGRESS for 2s [ 1069.301986] env[69188]: INFO networking_nsxv3.common.synchronization [req-0ab5cce6-3988-4e8c-b791-74ee509358f8 req-6ff0ae5b-a36f-4d35-8e42-1c543325339f service nova] Enqueued Resource ID: 938f39e5-b2c4-4a5d-b8ea-03c277953ec9 with Priority: HIGHEST for action security_group_rules [ 1069.302258] env[69188]: INFO networking_nsxv3.common.synchronization [req-0ab5cce6-3988-4e8c-b791-74ee509358f8 req-6ff0ae5b-a36f-4d35-8e42-1c543325339f service nova] Enqueued Resource ID: 938f39e5-b2c4-4a5d-b8ea-03c277953ec9 with Priority: HIGHEST for action security_group_members [ 1069.302431] env[69188]: INFO networking_nsxv3.common.synchronization [req-0ab5cce6-3988-4e8c-b791-74ee509358f8 req-6ff0ae5b-a36f-4d35-8e42-1c543325339f service nova] Enqueued Resource ID: fdd614bf-27a5-4b0e-a8a4-b7087bc76b69 with Priority: HIGHEST for action port [ 1069.302673] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 938f39e5-b2c4-4a5d-b8ea-03c277953ec9 with Priority: HIGHEST for action security_group_rules [ 1069.302859] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 938f39e5-b2c4-4a5d-b8ea-03c277953ec9 with Priority: HIGHEST for action security_group_members [ 1069.302992] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fdd614bf-27a5-4b0e-a8a4-b7087bc76b69 with Priority: HIGHEST for action port [ 1069.305027] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-938f39e5-b2c4-4a5d-b8ea-03c277953ec9 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.305027] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-938f39e5-b2c4-4a5d-b8ea-03c277953ec9" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.305027] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-938f39e5-b2c4-4a5d-b8ea-03c277953ec9" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.305027] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-938f39e5-b2c4-4a5d-b8ea-03c277953ec9" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.305027] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('938f39e5-b2c4-4a5d-b8ea-03c277953ec9',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1069.305822] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-938f39e5-b2c4-4a5d-b8ea-03c277953ec9 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.305923] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-938f39e5-b2c4-4a5d-b8ea-03c277953ec9" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.306125] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-fdd614bf-27a5-4b0e-a8a4-b7087bc76b69 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.306216] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fdd614bf-27a5-4b0e-a8a4-b7087bc76b69" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.306281] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fdd614bf-27a5-4b0e-a8a4-b7087bc76b69" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.306450] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fdd614bf-27a5-4b0e-a8a4-b7087bc76b69" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.306527] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fdd614bf-27a5-4b0e-a8a4-b7087bc76b69',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1069.353012] env[69188]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1069.353462] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.353628] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.353692] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.353852] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.353991] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.379365] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6551850f-c3f5-470f-b5eb-f7d542ab3a90 in Status: IN_PROGRESS for 2s [ 1069.758511] env[69188]: INFO networking_nsxv3.common.synchronization [req-c2b00845-1add-4569-b445-ed363f4dad3e req-03da9f0e-8f92-493f-8f35-296d1f679127 tempest-ServersTestJSON-1495057482 tempest-ServersTestJSON-1495057482-project-member] Enqueued Resource ID: 9f2518e8-b195-4520-b262-caa765ab7e27 with Priority: HIGHEST for action security_group_members [ 1069.760388] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f2518e8-b195-4520-b262-caa765ab7e27 with Priority: HIGHEST for action security_group_members [ 1069.760562] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-9f2518e8-b195-4520-b262-caa765ab7e27 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.760562] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9f2518e8-b195-4520-b262-caa765ab7e27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.760702] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9f2518e8-b195-4520-b262-caa765ab7e27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.760903] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9f2518e8-b195-4520-b262-caa765ab7e27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.761083] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.761174] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.761270] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.761393] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.761490] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.761573] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9f2518e8-b195-4520-b262-caa765ab7e27',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1069.809209] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-938f39e5-b2c4-4a5d-b8ea-03c277953ec9 taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.809209] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-938f39e5-b2c4-4a5d-b8ea-03c277953ec9" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.809484] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fdd614bf-27a5-4b0e-a8a4-b7087bc76b69 with status ACTIVE [ 1069.809484] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.809661] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.809786] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.810022] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.810116] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.810308] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.810407] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.810474] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.810674] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.810768] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.810964] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.811069] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.811138] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.811309] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.811386] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.811479] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fdd614bf-27a5-4b0e-a8a4-b7087bc76b69 is going to be updated. [ 1069.846808] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.846973] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.847023] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.847226] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.847361] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.847522] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fdd614bf-27a5-4b0e-a8a4-b7087bc76b69" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.026693] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 12570d95-0a4a-4579-82c8-53ecf65f714e in Status: SUCCESS [ 1070.026985] env[69188]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 12570d95-0a4a-4579-82c8-53ecf65f714e deletion is rescheduled due to dependency. [ 1070.026985] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-12570d95-0a4a-4579-82c8-53ecf65f714e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.114709] env[69188]: INFO networking_nsxv3.common.synchronization [req-cbbb0d8c-8650-42fb-bc29-dcd2d7386420 req-65bb5d06-2454-40a9-82b3-5d6af9f1e3a8 tempest-AttachInterfacesTestJSON-1255877948 tempest-AttachInterfacesTestJSON-1255877948-project-member] Enqueued Resource ID: 048d5e2e-adfe-4bc0-9ae5-f6d99d633e62 with Priority: HIGHEST for action security_group_members [ 1070.114876] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 048d5e2e-adfe-4bc0-9ae5-f6d99d633e62 with Priority: HIGHEST for action security_group_members [ 1070.115211] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-048d5e2e-adfe-4bc0-9ae5-f6d99d633e62 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.115332] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-048d5e2e-adfe-4bc0-9ae5-f6d99d633e62" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.115402] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-048d5e2e-adfe-4bc0-9ae5-f6d99d633e62" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.115600] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-048d5e2e-adfe-4bc0-9ae5-f6d99d633e62" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.115873] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.115985] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.116050] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.116203] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.116335] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.116541] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('048d5e2e-adfe-4bc0-9ae5-f6d99d633e62',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.263435] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9f2518e8-b195-4520-b262-caa765ab7e27',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.618476] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.618675] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.618769] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.618922] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.640078] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.640394] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.640540] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.640748] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.641812] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.641812] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.641812] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 048d5e2e-adfe-4bc0-9ae5-f6d99d633e62 is going to be updated. [ 1070.665111] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.665277] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.665321] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.665598] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.665703] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.676180] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 048d5e2e-adfe-4bc0-9ae5-f6d99d633e62 in Status: IN_PROGRESS for 2s [ 1070.766831] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9f2518e8-b195-4520-b262-caa765ab7e27',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1071.189857] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4c598260-71fe-43f5-ab89-63a95724ea23 in Status: SUCCESS [ 1071.190195] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4c598260-71fe-43f5-ab89-63a95724ea23" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.223586] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 938f39e5-b2c4-4a5d-b8ea-03c277953ec9 in Status: SUCCESS [ 1071.223884] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-938f39e5-b2c4-4a5d-b8ea-03c277953ec9" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.224115] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-938f39e5-b2c4-4a5d-b8ea-03c277953ec9" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.224374] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-938f39e5-b2c4-4a5d-b8ea-03c277953ec9" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.224628] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.224803] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.224916] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.225161] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.225296] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.225438] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('938f39e5-b2c4-4a5d-b8ea-03c277953ec9',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1071.226869] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 199db626-eef5-4a20-b92a-585841c1cff4 in Status: SUCCESS [ 1071.227099] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-199db626-eef5-4a20-b92a-585841c1cff4" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.227295] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-199db626-eef5-4a20-b92a-585841c1cff4" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.227505] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-199db626-eef5-4a20-b92a-585841c1cff4" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.227743] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.227900] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.228019] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.228411] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.228411] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.228526] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-199db626-eef5-4a20-b92a-585841c1cff4" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.228636] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('199db626-eef5-4a20-b92a-585841c1cff4',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1071.248134] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e3296f55-96ac-44eb-a498-8c6ab147c5ab in Status: SUCCESS [ 1071.248357] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e3296f55-96ac-44eb-a498-8c6ab147c5ab" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.269278] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.269445] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.269517] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.269844] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.270495] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.270495] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9f2518e8-b195-4520-b262-caa765ab7e27 is going to be updated. [ 1071.294849] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fa6e8a6e-b63b-4248-b67b-4ae889fac90c in Status: SUCCESS [ 1071.294849] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fa6e8a6e-b63b-4248-b67b-4ae889fac90c" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.296673] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.296673] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.296673] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.296673] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.296673] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.305244] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9f2518e8-b195-4520-b262-caa765ab7e27 in Status: IN_PROGRESS for 2s [ 1071.397028] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6551850f-c3f5-470f-b5eb-f7d542ab3a90 in Status: SUCCESS [ 1071.397028] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6551850f-c3f5-470f-b5eb-f7d542ab3a90" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.731040] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('938f39e5-b2c4-4a5d-b8ea-03c277953ec9',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1071.732031] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-199db626-eef5-4a20-b92a-585841c1cff4 taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.732031] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-199db626-eef5-4a20-b92a-585841c1cff4" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.732031] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-199db626-eef5-4a20-b92a-585841c1cff4" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.732248] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-199db626-eef5-4a20-b92a-585841c1cff4" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.732382] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.732480] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.732543] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.732689] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.732771] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.732858] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-199db626-eef5-4a20-b92a-585841c1cff4" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.733016] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-199db626-eef5-4a20-b92a-585841c1cff4 taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.733133] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-199db626-eef5-4a20-b92a-585841c1cff4" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.733238] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-199db626-eef5-4a20-b92a-585841c1cff4" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.733313] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-199db626-eef5-4a20-b92a-585841c1cff4" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.733446] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.733534] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.733593] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.733744] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.733828] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.733909] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-199db626-eef5-4a20-b92a-585841c1cff4" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.733993] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('199db626-eef5-4a20-b92a-585841c1cff4',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1072.235966] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('938f39e5-b2c4-4a5d-b8ea-03c277953ec9',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1072.237961] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 199db626-eef5-4a20-b92a-585841c1cff4: rpc.has_security_group_logging(os_id): False [ 1072.254241] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.254410] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.254460] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.254713] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.272777] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.273138] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.273313] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.273386] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.273618] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.273708] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.273944] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.274107] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.274191] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.274364] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.274467] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.274711] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.274942] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.274942] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.275078] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.275160] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.275267] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 199db626-eef5-4a20-b92a-585841c1cff4 is going to be updated. [ 1072.334716] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.334873] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.334945] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.335175] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.335318] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.348995] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 199db626-eef5-4a20-b92a-585841c1cff4 in Status: IN_PROGRESS for 2s [ 1072.686262] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 048d5e2e-adfe-4bc0-9ae5-f6d99d633e62 in Status: SUCCESS [ 1072.686526] env[69188]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 048d5e2e-adfe-4bc0-9ae5-f6d99d633e62 deletion is rescheduled due to dependency. [ 1072.686718] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-048d5e2e-adfe-4bc0-9ae5-f6d99d633e62" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.740941] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.741855] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.744124] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.744124] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.744124] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.744124] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 938f39e5-b2c4-4a5d-b8ea-03c277953ec9 is going to be updated. [ 1072.784540] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.784540] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.784540] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.785037] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.785037] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.794942] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 938f39e5-b2c4-4a5d-b8ea-03c277953ec9 in Status: IN_PROGRESS for 2s [ 1073.314866] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9f2518e8-b195-4520-b262-caa765ab7e27 in Status: SUCCESS [ 1073.315186] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9f2518e8-b195-4520-b262-caa765ab7e27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.367659] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 199db626-eef5-4a20-b92a-585841c1cff4 in Status: SUCCESS [ 1074.367952] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-199db626-eef5-4a20-b92a-585841c1cff4" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.368142] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-199db626-eef5-4a20-b92a-585841c1cff4" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.368365] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-199db626-eef5-4a20-b92a-585841c1cff4" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.368457] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('199db626-eef5-4a20-b92a-585841c1cff4',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1074.805888] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 938f39e5-b2c4-4a5d-b8ea-03c277953ec9 in Status: SUCCESS [ 1074.806235] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-938f39e5-b2c4-4a5d-b8ea-03c277953ec9" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.806500] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-938f39e5-b2c4-4a5d-b8ea-03c277953ec9" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.806914] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-938f39e5-b2c4-4a5d-b8ea-03c277953ec9" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.807168] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.807329] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.807428] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.807644] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.807823] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.807997] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-938f39e5-b2c4-4a5d-b8ea-03c277953ec9" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.808187] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('938f39e5-b2c4-4a5d-b8ea-03c277953ec9',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1074.870457] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-199db626-eef5-4a20-b92a-585841c1cff4 taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.870676] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-199db626-eef5-4a20-b92a-585841c1cff4" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.870676] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-199db626-eef5-4a20-b92a-585841c1cff4" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.870936] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-199db626-eef5-4a20-b92a-585841c1cff4" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.871156] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.871255] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.871333] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.871496] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.871593] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.871694] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-199db626-eef5-4a20-b92a-585841c1cff4" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.871768] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('199db626-eef5-4a20-b92a-585841c1cff4',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1075.115730] env[69188]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1075.115862] env[69188]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1075.311844] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-938f39e5-b2c4-4a5d-b8ea-03c277953ec9 taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.311844] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-938f39e5-b2c4-4a5d-b8ea-03c277953ec9" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.311844] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-938f39e5-b2c4-4a5d-b8ea-03c277953ec9" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.311844] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-938f39e5-b2c4-4a5d-b8ea-03c277953ec9" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.312184] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.312184] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.312184] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.312333] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.312433] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.312550] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-938f39e5-b2c4-4a5d-b8ea-03c277953ec9" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.312702] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-938f39e5-b2c4-4a5d-b8ea-03c277953ec9 taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.312816] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-938f39e5-b2c4-4a5d-b8ea-03c277953ec9" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.312901] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-938f39e5-b2c4-4a5d-b8ea-03c277953ec9" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.313093] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-938f39e5-b2c4-4a5d-b8ea-03c277953ec9" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.313304] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.313487] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.313538] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.313711] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.313762] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.313883] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-938f39e5-b2c4-4a5d-b8ea-03c277953ec9" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.314016] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('938f39e5-b2c4-4a5d-b8ea-03c277953ec9',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1075.376017] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-199db626-eef5-4a20-b92a-585841c1cff4 taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.376017] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-199db626-eef5-4a20-b92a-585841c1cff4" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.376017] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-199db626-eef5-4a20-b92a-585841c1cff4" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.376017] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-199db626-eef5-4a20-b92a-585841c1cff4" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.376017] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.376017] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.376017] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.376017] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.376017] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.376017] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-199db626-eef5-4a20-b92a-585841c1cff4" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.376017] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-199db626-eef5-4a20-b92a-585841c1cff4 taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.376017] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-199db626-eef5-4a20-b92a-585841c1cff4" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.376017] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-199db626-eef5-4a20-b92a-585841c1cff4" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.376017] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-199db626-eef5-4a20-b92a-585841c1cff4" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.376017] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.376844] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.376844] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.376844] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.376844] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.376844] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-199db626-eef5-4a20-b92a-585841c1cff4" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.376844] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('199db626-eef5-4a20-b92a-585841c1cff4',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1075.816806] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 938f39e5-b2c4-4a5d-b8ea-03c277953ec9: rpc.has_security_group_logging(os_id): False [ 1075.835492] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.835571] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.835630] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.836014] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.843389] env[69188]: INFO networking_nsxv3.common.synchronization [req-c724958c-c9b2-4d70-a4fa-ce6bb7eb5923 req-fd63467a-7606-40b2-8b7d-34921de8576c tempest-ListServersNegativeTestJSON-350712182 tempest-ListServersNegativeTestJSON-350712182-project-member] Enqueued Resource ID: bec5fbed-ec5a-4f98-90d3-ee0000b97d09 with Priority: HIGHEST for action security_group_members [ 1075.844211] env[69188]: INFO networking_nsxv3.common.synchronization [req-8d605af5-fc03-4e61-a647-661ea7cae7c4 req-d5adca3d-fbd3-4b7d-a2d0-bfc799024cca tempest-ListServersNegativeTestJSON-350712182 tempest-ListServersNegativeTestJSON-350712182-project-member] Enqueued Resource ID: bec5fbed-ec5a-4f98-90d3-ee0000b97d09 with Priority: HIGHEST for action security_group_members [ 1075.844211] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bec5fbed-ec5a-4f98-90d3-ee0000b97d09 with Priority: HIGHEST for action security_group_members [ 1075.844620] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-bec5fbed-ec5a-4f98-90d3-ee0000b97d09 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.844752] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bec5fbed-ec5a-4f98-90d3-ee0000b97d09" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.844833] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bec5fbed-ec5a-4f98-90d3-ee0000b97d09" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.845039] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bec5fbed-ec5a-4f98-90d3-ee0000b97d09" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.845142] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.845237] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.845305] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.845975] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.845975] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.845975] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bec5fbed-ec5a-4f98-90d3-ee0000b97d09',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1075.852518] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.852740] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.852850] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.852911] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.853162] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.853372] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.853460] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.853582] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.853582] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.853744] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.853808] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.854372] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.854372] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.854372] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.854372] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.854372] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.855206] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 938f39e5-b2c4-4a5d-b8ea-03c277953ec9 is going to be updated. [ 1075.879401] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 199db626-eef5-4a20-b92a-585841c1cff4: rpc.has_security_group_logging(os_id): False [ 1075.895986] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.895986] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.895986] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.896164] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.896251] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.896411] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.896514] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.897055] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.897055] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.897055] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.897055] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.897243] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.897243] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.897301] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.897331] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.897515] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.897629] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.897671] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.897876] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.897959] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.898195] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 199db626-eef5-4a20-b92a-585841c1cff4 is going to be updated. [ 1075.911864] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.912053] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.912191] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.912400] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.912978] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.923021] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 938f39e5-b2c4-4a5d-b8ea-03c277953ec9 in Status: IN_PROGRESS for 2s [ 1075.956121] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.956268] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.956330] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.956549] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.956741] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.970044] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 199db626-eef5-4a20-b92a-585841c1cff4 in Status: IN_PROGRESS for 2s [ 1076.349072] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.349218] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.349290] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.349509] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.368868] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.369114] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.369269] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.369316] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.369464] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.369545] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.369651] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bec5fbed-ec5a-4f98-90d3-ee0000b97d09 is going to be updated. [ 1076.392937] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.393330] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.393330] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.393407] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.393610] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.401143] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bec5fbed-ec5a-4f98-90d3-ee0000b97d09 in Status: IN_PROGRESS for 2s [ 1077.936378] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 938f39e5-b2c4-4a5d-b8ea-03c277953ec9 in Status: SUCCESS [ 1077.936691] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-938f39e5-b2c4-4a5d-b8ea-03c277953ec9" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.983625] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 199db626-eef5-4a20-b92a-585841c1cff4 in Status: SUCCESS [ 1077.983858] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-199db626-eef5-4a20-b92a-585841c1cff4" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.411399] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bec5fbed-ec5a-4f98-90d3-ee0000b97d09 in Status: SUCCESS [ 1078.411610] env[69188]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bec5fbed-ec5a-4f98-90d3-ee0000b97d09 deletion is rescheduled due to dependency. [ 1078.411761] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bec5fbed-ec5a-4f98-90d3-ee0000b97d09" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.845075] env[69188]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1080.845946] env[69188]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1081.334556] env[69188]: INFO networking_nsxv3.common.synchronization [req-7e399336-e2ad-409f-8815-605826fe240b req-f51ee4ab-b056-4733-8227-e0450410eca7 tempest-ServersTestJSON-1495057482 tempest-ServersTestJSON-1495057482-project-member] Enqueued Resource ID: 9f2518e8-b195-4520-b262-caa765ab7e27 with Priority: HIGHEST for action security_group_members [ 1081.334556] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f2518e8-b195-4520-b262-caa765ab7e27 with Priority: HIGHEST for action security_group_members [ 1081.334556] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-9f2518e8-b195-4520-b262-caa765ab7e27 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.334556] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9f2518e8-b195-4520-b262-caa765ab7e27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.334556] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9f2518e8-b195-4520-b262-caa765ab7e27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.334740] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9f2518e8-b195-4520-b262-caa765ab7e27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.334865] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.334988] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.335062] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.335264] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.335346] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.335451] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9f2518e8-b195-4520-b262-caa765ab7e27',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1081.556694] env[69188]: INFO networking_nsxv3.common.synchronization [None req-e9f9d2f2-f834-4035-b055-e78a6077bf7e tempest-AttachInterfacesTestJSON-1255877948 tempest-AttachInterfacesTestJSON-1255877948-project-member] Enqueued Resource ID: 0ba9367f-1279-4e82-9eaa-4519ee3a1efb with Priority: HIGHEST for action security_group_rules [ 1081.557341] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0ba9367f-1279-4e82-9eaa-4519ee3a1efb with Priority: HIGHEST for action security_group_rules [ 1081.557696] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0ba9367f-1279-4e82-9eaa-4519ee3a1efb taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.557884] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0ba9367f-1279-4e82-9eaa-4519ee3a1efb" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.557948] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0ba9367f-1279-4e82-9eaa-4519ee3a1efb" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.558212] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0ba9367f-1279-4e82-9eaa-4519ee3a1efb" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.558325] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0ba9367f-1279-4e82-9eaa-4519ee3a1efb',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1081.632195] env[69188]: INFO networking_nsxv3.common.synchronization [None req-125bfb56-b32d-485b-8687-9ade6cba8c22 tempest-AttachInterfacesTestJSON-1255877948 tempest-AttachInterfacesTestJSON-1255877948-project-member] Enqueued Resource ID: 0ba9367f-1279-4e82-9eaa-4519ee3a1efb with Priority: HIGHEST for action security_group_rules [ 1081.632716] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0ba9367f-1279-4e82-9eaa-4519ee3a1efb with Priority: HIGHEST for action security_group_rules [ 1081.633024] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0ba9367f-1279-4e82-9eaa-4519ee3a1efb taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.633144] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0ba9367f-1279-4e82-9eaa-4519ee3a1efb" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.839727] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9f2518e8-b195-4520-b262-caa765ab7e27',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1082.077885] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.077885] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.077885] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.078342] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.078342] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.078342] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0ba9367f-1279-4e82-9eaa-4519ee3a1efb already deleted. [ 1082.078437] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0ba9367f-1279-4e82-9eaa-4519ee3a1efb" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.078579] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0ba9367f-1279-4e82-9eaa-4519ee3a1efb" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.078739] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0ba9367f-1279-4e82-9eaa-4519ee3a1efb" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.078823] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0ba9367f-1279-4e82-9eaa-4519ee3a1efb',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1082.342280] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9f2518e8-b195-4520-b262-caa765ab7e27',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1082.603064] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.603231] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.603231] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.603428] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.603517] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.603611] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0ba9367f-1279-4e82-9eaa-4519ee3a1efb already deleted. [ 1082.603690] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0ba9367f-1279-4e82-9eaa-4519ee3a1efb" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.845517] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.845517] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.845517] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.845517] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.845762] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.845762] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9f2518e8-b195-4520-b262-caa765ab7e27 is going to be updated. [ 1082.873389] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.873389] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.873389] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.873595] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.873815] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.882359] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9f2518e8-b195-4520-b262-caa765ab7e27 in Status: IN_PROGRESS for 2s [ 1083.006624] env[69188]: INFO networking_nsxv3.common.synchronization [req-fcf1ae52-9d31-48b2-bc12-afcb606bdb4b req-6e2c62b2-6631-484a-afa0-1114c47fd9e6 tempest-ServerActionsTestOtherB-2131451762 tempest-ServerActionsTestOtherB-2131451762-project-member] Enqueued Resource ID: 867581e0-cbbd-4108-a823-0b7c53d47c3a with Priority: HIGHEST for action security_group_members [ 1083.007185] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 867581e0-cbbd-4108-a823-0b7c53d47c3a with Priority: HIGHEST for action security_group_members [ 1083.007536] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-867581e0-cbbd-4108-a823-0b7c53d47c3a taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.007668] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-867581e0-cbbd-4108-a823-0b7c53d47c3a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.007752] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-867581e0-cbbd-4108-a823-0b7c53d47c3a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.008016] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-867581e0-cbbd-4108-a823-0b7c53d47c3a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.008323] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.008435] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.008495] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.012993] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.012993] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.012993] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('867581e0-cbbd-4108-a823-0b7c53d47c3a',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1083.516623] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.517037] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.517037] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.517130] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.549051] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.549374] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.549518] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.549615] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.549867] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.550124] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.550236] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 867581e0-cbbd-4108-a823-0b7c53d47c3a is going to be updated. [ 1083.581869] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.582080] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.582080] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.582291] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.582429] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.595160] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 867581e0-cbbd-4108-a823-0b7c53d47c3a in Status: IN_PROGRESS for 2s [ 1083.820026] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock network-154 taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.820304] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "network-154" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.820412] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "network-154" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.820712] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "network-154" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.821781] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.823428] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.823428] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.823428] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.823428] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.823428] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1083.823428] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] NeedRegenerationException {{(pid=69188) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1083.823428] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] no value, waiting for create lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1083.823428] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] value creation lock acquired {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1083.823428] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1083.823956] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Calling creation function for not-yet-present value {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1083.823956] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1083.842075] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1083.842280] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69188) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1083.842439] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Released creation lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1083.842632] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "network-154" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.845918] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock port-a2ed526e-c4fb-4848-9ddc-c7e2650007e1 taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.845918] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "port-a2ed526e-c4fb-4848-9ddc-c7e2650007e1" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.845918] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "port-a2ed526e-c4fb-4848-9ddc-c7e2650007e1" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.845918] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "port-a2ed526e-c4fb-4848-9ddc-c7e2650007e1" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.845918] env[69188]: DEBUG networking_nsxv3.api.rpc [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a2ed526e-c4fb-4848-9ddc-c7e2650007e1',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1083.855872] env[69188]: INFO networking_nsxv3.common.synchronization [req-22d9b5f8-7d81-49c9-ab57-4cc2f1817e6f req-e2421b04-7cf1-4de8-b6d8-97301e1a7a1b tempest-ServersNegativeTestJSON-5747953 tempest-ServersNegativeTestJSON-5747953-project-member] Enqueued Resource ID: 938f39e5-b2c4-4a5d-b8ea-03c277953ec9 with Priority: HIGHEST for action security_group_members [ 1083.855958] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 938f39e5-b2c4-4a5d-b8ea-03c277953ec9 with Priority: HIGHEST for action security_group_members [ 1083.856535] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-938f39e5-b2c4-4a5d-b8ea-03c277953ec9 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.856715] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-938f39e5-b2c4-4a5d-b8ea-03c277953ec9" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.856779] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-938f39e5-b2c4-4a5d-b8ea-03c277953ec9" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.856970] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-938f39e5-b2c4-4a5d-b8ea-03c277953ec9" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.857165] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.857265] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.857342] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.857559] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.857699] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.857813] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('938f39e5-b2c4-4a5d-b8ea-03c277953ec9',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1084.346097] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.346432] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.346636] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.346982] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.347210] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.347422] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Segment Port a2ed526e-c4fb-4848-9ddc-c7e2650007e1 not found, creating... [ 1084.347748] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.347957] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.348149] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.348432] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.348616] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.348972] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.349207] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.350034] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.350034] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.350034] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.350034] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Resource: SegmentPort with ID: a2ed526e-c4fb-4848-9ddc-c7e2650007e1 is going to be created. [ 1084.359809] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('938f39e5-b2c4-4a5d-b8ea-03c277953ec9',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1084.369365] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.369569] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.369695] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.369994] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.370254] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.370484] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "port-a2ed526e-c4fb-4848-9ddc-c7e2650007e1" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.861715] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('938f39e5-b2c4-4a5d-b8ea-03c277953ec9',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1084.893796] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9f2518e8-b195-4520-b262-caa765ab7e27 in Status: SUCCESS [ 1084.894033] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9f2518e8-b195-4520-b262-caa765ab7e27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.149845] env[69188]: INFO networking_nsxv3.common.synchronization [req-fcf1ae52-9d31-48b2-bc12-afcb606bdb4b req-10a81be2-05c3-4f3d-b413-f7d4e9963b62 service nova] Enqueued Resource ID: 867581e0-cbbd-4108-a823-0b7c53d47c3a with Priority: HIGHEST for action security_group_rules [ 1085.150207] env[69188]: INFO networking_nsxv3.common.synchronization [req-fcf1ae52-9d31-48b2-bc12-afcb606bdb4b req-10a81be2-05c3-4f3d-b413-f7d4e9963b62 service nova] Enqueued Resource ID: 867581e0-cbbd-4108-a823-0b7c53d47c3a with Priority: HIGHEST for action security_group_members [ 1085.150412] env[69188]: INFO networking_nsxv3.common.synchronization [req-fcf1ae52-9d31-48b2-bc12-afcb606bdb4b req-10a81be2-05c3-4f3d-b413-f7d4e9963b62 service nova] Enqueued Resource ID: a2ed526e-c4fb-4848-9ddc-c7e2650007e1 with Priority: HIGHEST for action port [ 1085.151347] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 867581e0-cbbd-4108-a823-0b7c53d47c3a with Priority: HIGHEST for action security_group_rules [ 1085.151527] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 867581e0-cbbd-4108-a823-0b7c53d47c3a with Priority: HIGHEST for action security_group_members [ 1085.151649] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a2ed526e-c4fb-4848-9ddc-c7e2650007e1 with Priority: HIGHEST for action port [ 1085.151956] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-867581e0-cbbd-4108-a823-0b7c53d47c3a taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.152208] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-867581e0-cbbd-4108-a823-0b7c53d47c3a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.152325] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-867581e0-cbbd-4108-a823-0b7c53d47c3a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.152611] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-867581e0-cbbd-4108-a823-0b7c53d47c3a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.152716] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('867581e0-cbbd-4108-a823-0b7c53d47c3a',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1085.154239] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-867581e0-cbbd-4108-a823-0b7c53d47c3a taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.154359] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-867581e0-cbbd-4108-a823-0b7c53d47c3a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.154600] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-a2ed526e-c4fb-4848-9ddc-c7e2650007e1 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.154725] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a2ed526e-c4fb-4848-9ddc-c7e2650007e1" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.154795] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a2ed526e-c4fb-4848-9ddc-c7e2650007e1" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.155079] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a2ed526e-c4fb-4848-9ddc-c7e2650007e1" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.155167] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a2ed526e-c4fb-4848-9ddc-c7e2650007e1',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1085.367782] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.367980] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.368110] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.368338] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.368464] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.368569] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 938f39e5-b2c4-4a5d-b8ea-03c277953ec9 is going to be updated. [ 1085.396966] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.397171] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.397284] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.397546] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.397734] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.407072] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 938f39e5-b2c4-4a5d-b8ea-03c277953ec9 in Status: IN_PROGRESS for 2s [ 1085.603961] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 867581e0-cbbd-4108-a823-0b7c53d47c3a in Status: SUCCESS [ 1085.604193] env[69188]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 867581e0-cbbd-4108-a823-0b7c53d47c3a deletion is rescheduled due to dependency. [ 1085.604390] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-867581e0-cbbd-4108-a823-0b7c53d47c3a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.604507] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-867581e0-cbbd-4108-a823-0b7c53d47c3a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.604760] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-867581e0-cbbd-4108-a823-0b7c53d47c3a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.604953] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.605092] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.605173] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.605354] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.605463] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.605560] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('867581e0-cbbd-4108-a823-0b7c53d47c3a',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1085.656782] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-867581e0-cbbd-4108-a823-0b7c53d47c3a taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.656918] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-867581e0-cbbd-4108-a823-0b7c53d47c3a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.658291] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a2ed526e-c4fb-4848-9ddc-c7e2650007e1 with status ACTIVE [ 1085.658497] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.658618] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.658687] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.658935] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.659062] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.659245] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.659348] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.659424] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.659625] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.659712] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.659895] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.660058] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.660156] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.661974] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.661974] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.661974] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a2ed526e-c4fb-4848-9ddc-c7e2650007e1 is going to be updated. [ 1085.681942] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.682126] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.682173] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.682402] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.682591] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.682731] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a2ed526e-c4fb-4848-9ddc-c7e2650007e1" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.107968] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('867581e0-cbbd-4108-a823-0b7c53d47c3a',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1086.610881] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('867581e0-cbbd-4108-a823-0b7c53d47c3a',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1087.116170] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.116591] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.116591] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.116591] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.116796] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.116796] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 867581e0-cbbd-4108-a823-0b7c53d47c3a is going to be updated. [ 1087.146153] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.146367] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.146481] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.146830] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.147015] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.155084] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 867581e0-cbbd-4108-a823-0b7c53d47c3a in Status: IN_PROGRESS for 2s [ 1087.217158] env[69188]: INFO networking_nsxv3.common.synchronization [req-2ef72dd0-38ec-4f3a-9cd7-653aba751c92 req-b860c94f-202c-4c39-8454-25e2a5b21976 tempest-ServersTestBootFromVolume-721515798 tempest-ServersTestBootFromVolume-721515798-project-member] Enqueued Resource ID: 5f183b9d-5066-4eee-a079-2adf3a1d0f7c with Priority: HIGHEST for action security_group_members [ 1087.219902] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5f183b9d-5066-4eee-a079-2adf3a1d0f7c with Priority: HIGHEST for action security_group_members [ 1087.219902] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-5f183b9d-5066-4eee-a079-2adf3a1d0f7c taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.219902] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5f183b9d-5066-4eee-a079-2adf3a1d0f7c" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.219902] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5f183b9d-5066-4eee-a079-2adf3a1d0f7c" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.219902] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5f183b9d-5066-4eee-a079-2adf3a1d0f7c" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.219902] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.219902] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.219902] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.219902] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.219902] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.219902] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5f183b9d-5066-4eee-a079-2adf3a1d0f7c',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1087.416766] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 938f39e5-b2c4-4a5d-b8ea-03c277953ec9 in Status: SUCCESS [ 1087.417025] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-938f39e5-b2c4-4a5d-b8ea-03c277953ec9" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.723303] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.723466] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.723539] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.723734] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.749181] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.749504] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.749663] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.749759] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.749999] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.750108] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.750200] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5f183b9d-5066-4eee-a079-2adf3a1d0f7c is going to be updated. [ 1087.786830] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.787027] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.787083] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.787274] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.787431] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.798899] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5f183b9d-5066-4eee-a079-2adf3a1d0f7c in Status: IN_PROGRESS for 2s [ 1088.426287] env[69188]: INFO networking_nsxv3.common.synchronization [req-1ded6c77-b65a-420a-9c67-722bdbdebff3 req-4243ef0a-1763-40a8-ae0a-bce7b5a726d4 tempest-ImagesTestJSON-2034330654 tempest-ImagesTestJSON-2034330654-project-member] Enqueued Resource ID: 199db626-eef5-4a20-b92a-585841c1cff4 with Priority: HIGHEST for action security_group_members [ 1088.426540] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 199db626-eef5-4a20-b92a-585841c1cff4 with Priority: HIGHEST for action security_group_members [ 1088.426918] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-199db626-eef5-4a20-b92a-585841c1cff4 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.426918] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-199db626-eef5-4a20-b92a-585841c1cff4" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.426918] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-199db626-eef5-4a20-b92a-585841c1cff4" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.427284] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-199db626-eef5-4a20-b92a-585841c1cff4" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.427461] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.427591] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.427661] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.427852] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.427944] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.428095] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('199db626-eef5-4a20-b92a-585841c1cff4',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1088.930527] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.930729] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.930779] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.931080] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.931186] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.931385] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.931484] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.931550] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.931702] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.931781] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.931895] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 199db626-eef5-4a20-b92a-585841c1cff4 is going to be updated. [ 1088.958534] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.958715] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.958794] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.958997] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.959164] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.967889] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 199db626-eef5-4a20-b92a-585841c1cff4 in Status: IN_PROGRESS for 2s [ 1089.164617] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 867581e0-cbbd-4108-a823-0b7c53d47c3a in Status: SUCCESS [ 1089.164891] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-867581e0-cbbd-4108-a823-0b7c53d47c3a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.165120] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-867581e0-cbbd-4108-a823-0b7c53d47c3a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.165342] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-867581e0-cbbd-4108-a823-0b7c53d47c3a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.165555] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.165675] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.165759] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.165915] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.166024] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.166113] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-867581e0-cbbd-4108-a823-0b7c53d47c3a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.166215] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('867581e0-cbbd-4108-a823-0b7c53d47c3a',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1089.668926] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('867581e0-cbbd-4108-a823-0b7c53d47c3a',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1089.807380] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5f183b9d-5066-4eee-a079-2adf3a1d0f7c in Status: SUCCESS [ 1089.807576] env[69188]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5f183b9d-5066-4eee-a079-2adf3a1d0f7c deletion is rescheduled due to dependency. [ 1089.807694] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5f183b9d-5066-4eee-a079-2adf3a1d0f7c" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.171042] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 867581e0-cbbd-4108-a823-0b7c53d47c3a: rpc.has_security_group_logging(os_id): False [ 1090.187217] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.187368] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.187412] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.187655] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.187750] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.188014] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.188115] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.188178] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.188327] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.188405] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.188491] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 867581e0-cbbd-4108-a823-0b7c53d47c3a is going to be updated. [ 1090.245860] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.246077] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.246077] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.246333] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.246485] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.257492] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 867581e0-cbbd-4108-a823-0b7c53d47c3a in Status: IN_PROGRESS for 2s [ 1090.977731] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 199db626-eef5-4a20-b92a-585841c1cff4 in Status: SUCCESS [ 1090.977731] env[69188]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 199db626-eef5-4a20-b92a-585841c1cff4 deletion is rescheduled due to dependency. [ 1090.977731] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-199db626-eef5-4a20-b92a-585841c1cff4" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.222859] env[69188]: INFO networking_nsxv3.common.synchronization [req-69f43d55-c348-4e78-83f2-8766229f0aa9 req-cb1f00c1-5442-4c7e-9525-1d120ab4ae00 tempest-ServerDiskConfigTestJSON-1476779099 tempest-ServerDiskConfigTestJSON-1476779099-project-member] Enqueued Resource ID: 24a7b083-b432-46d6-94de-76adf6ce22b3 with Priority: HIGHEST for action security_group_members [ 1091.222859] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 24a7b083-b432-46d6-94de-76adf6ce22b3 with Priority: HIGHEST for action security_group_members [ 1091.222859] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-24a7b083-b432-46d6-94de-76adf6ce22b3 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.225712] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-24a7b083-b432-46d6-94de-76adf6ce22b3" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.225712] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-24a7b083-b432-46d6-94de-76adf6ce22b3" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.225712] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-24a7b083-b432-46d6-94de-76adf6ce22b3" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.225712] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.225712] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.225712] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.225712] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.225712] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.225712] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('24a7b083-b432-46d6-94de-76adf6ce22b3',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.434644] env[69188]: INFO networking_nsxv3.common.synchronization [req-9dc1e19e-7aca-44b6-8b42-724105b4e1f9 req-27e0c60b-ba24-423b-bce7-b2e2f49e3630 tempest-DeleteServersTestJSON-857706435 tempest-DeleteServersTestJSON-857706435-project-member] Enqueued Resource ID: 397559b2-3c5a-424d-b09d-43a25d2abba6 with Priority: HIGHEST for action security_group_members [ 1091.435087] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 397559b2-3c5a-424d-b09d-43a25d2abba6 with Priority: HIGHEST for action security_group_members [ 1091.435387] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-397559b2-3c5a-424d-b09d-43a25d2abba6 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.435506] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-397559b2-3c5a-424d-b09d-43a25d2abba6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.435570] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-397559b2-3c5a-424d-b09d-43a25d2abba6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.435778] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-397559b2-3c5a-424d-b09d-43a25d2abba6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.435927] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.436032] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.436097] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.436232] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.436315] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.436405] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('397559b2-3c5a-424d-b09d-43a25d2abba6',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.726624] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.726782] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.726851] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.727090] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.746087] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.746336] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.746452] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.746510] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.746697] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.746779] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.746869] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 24a7b083-b432-46d6-94de-76adf6ce22b3 is going to be updated. [ 1091.770833] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock network-449 taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.771041] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "network-449" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.771190] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "network-449" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.771467] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "network-449" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.771728] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.771881] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.772017] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.773179] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.773179] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.773179] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1091.773179] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] NeedRegenerationException {{(pid=69188) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1091.773179] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] no value, waiting for create lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1091.773179] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] value creation lock acquired {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1091.775239] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1091.775380] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Calling creation function for not-yet-present value {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1091.775716] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1091.777638] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.777825] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.778363] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.778363] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.778506] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.787570] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 24a7b083-b432-46d6-94de-76adf6ce22b3 in Status: IN_PROGRESS for 2s [ 1091.796525] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1091.796705] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69188) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1091.796862] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Released creation lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1091.797022] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "network-449" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.797349] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock port-ed0e2d57-191a-4979-b692-e6af2126ab6c taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.797525] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "port-ed0e2d57-191a-4979-b692-e6af2126ab6c" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.797650] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "port-ed0e2d57-191a-4979-b692-e6af2126ab6c" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.798006] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "port-ed0e2d57-191a-4979-b692-e6af2126ab6c" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.798371] env[69188]: DEBUG networking_nsxv3.api.rpc [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ed0e2d57-191a-4979-b692-e6af2126ab6c',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.941184] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.941363] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.941442] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.941658] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.941751] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.941953] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.942062] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.942127] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.942278] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.942354] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.942451] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 397559b2-3c5a-424d-b09d-43a25d2abba6 is going to be deleted. [ 1091.969324] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.969489] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.969531] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.969679] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.969764] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.969856] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-397559b2-3c5a-424d-b09d-43a25d2abba6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.269211] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 867581e0-cbbd-4108-a823-0b7c53d47c3a in Status: SUCCESS [ 1092.269449] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-867581e0-cbbd-4108-a823-0b7c53d47c3a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.301157] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.301157] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.301157] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.301157] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.301157] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.301352] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Segment Port ed0e2d57-191a-4979-b692-e6af2126ab6c not found, creating... [ 1092.301535] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.301695] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.301816] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.302061] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.302211] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.302499] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.302657] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.302825] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.302992] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.303149] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.303296] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Resource: SegmentPort with ID: ed0e2d57-191a-4979-b692-e6af2126ab6c is going to be created. [ 1092.323696] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.323898] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.324048] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.324309] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.324554] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.324783] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "port-ed0e2d57-191a-4979-b692-e6af2126ab6c" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.064450] env[69188]: INFO networking_nsxv3.common.synchronization [req-9dc1e19e-7aca-44b6-8b42-724105b4e1f9 req-3b9aee7f-d094-46d8-8a23-8668728da3bf service nova] Enqueued Resource ID: 397559b2-3c5a-424d-b09d-43a25d2abba6 with Priority: HIGHEST for action security_group_rules [ 1093.064671] env[69188]: INFO networking_nsxv3.common.synchronization [req-9dc1e19e-7aca-44b6-8b42-724105b4e1f9 req-3b9aee7f-d094-46d8-8a23-8668728da3bf service nova] Enqueued Resource ID: 397559b2-3c5a-424d-b09d-43a25d2abba6 with Priority: HIGHEST for action security_group_members [ 1093.064843] env[69188]: INFO networking_nsxv3.common.synchronization [req-9dc1e19e-7aca-44b6-8b42-724105b4e1f9 req-3b9aee7f-d094-46d8-8a23-8668728da3bf service nova] Enqueued Resource ID: ed0e2d57-191a-4979-b692-e6af2126ab6c with Priority: HIGHEST for action port [ 1093.065073] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 397559b2-3c5a-424d-b09d-43a25d2abba6 with Priority: HIGHEST for action security_group_rules [ 1093.065220] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 397559b2-3c5a-424d-b09d-43a25d2abba6 with Priority: HIGHEST for action security_group_members [ 1093.065319] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ed0e2d57-191a-4979-b692-e6af2126ab6c with Priority: HIGHEST for action port [ 1093.065900] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-397559b2-3c5a-424d-b09d-43a25d2abba6 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.066047] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-397559b2-3c5a-424d-b09d-43a25d2abba6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.066130] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-397559b2-3c5a-424d-b09d-43a25d2abba6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.066345] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-397559b2-3c5a-424d-b09d-43a25d2abba6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.066426] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('397559b2-3c5a-424d-b09d-43a25d2abba6',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1093.067807] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-397559b2-3c5a-424d-b09d-43a25d2abba6 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.067903] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-397559b2-3c5a-424d-b09d-43a25d2abba6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.067983] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-397559b2-3c5a-424d-b09d-43a25d2abba6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.068203] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-397559b2-3c5a-424d-b09d-43a25d2abba6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.068370] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.068470] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.068544] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.068689] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.068786] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.068877] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('397559b2-3c5a-424d-b09d-43a25d2abba6',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1093.069647] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-ed0e2d57-191a-4979-b692-e6af2126ab6c taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.069760] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ed0e2d57-191a-4979-b692-e6af2126ab6c" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.069827] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ed0e2d57-191a-4979-b692-e6af2126ab6c" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.070210] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ed0e2d57-191a-4979-b692-e6af2126ab6c" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.070210] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ed0e2d57-191a-4979-b692-e6af2126ab6c',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1093.572217] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-397559b2-3c5a-424d-b09d-43a25d2abba6 taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.572569] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-397559b2-3c5a-424d-b09d-43a25d2abba6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.572569] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ed0e2d57-191a-4979-b692-e6af2126ab6c with status ACTIVE [ 1093.572724] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.573232] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.573232] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.573232] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.573232] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.573462] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.573462] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.573540] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.573633] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.573707] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.573924] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.574066] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.574066] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.574537] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.574537] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.574537] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ed0e2d57-191a-4979-b692-e6af2126ab6c is going to be updated. [ 1093.575397] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('397559b2-3c5a-424d-b09d-43a25d2abba6',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1093.594422] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.594573] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.594646] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.594843] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.594978] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.595165] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ed0e2d57-191a-4979-b692-e6af2126ab6c" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.796860] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 24a7b083-b432-46d6-94de-76adf6ce22b3 in Status: SUCCESS [ 1093.797057] env[69188]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 24a7b083-b432-46d6-94de-76adf6ce22b3 deletion is rescheduled due to dependency. [ 1093.797170] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-24a7b083-b432-46d6-94de-76adf6ce22b3" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.078013] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('397559b2-3c5a-424d-b09d-43a25d2abba6',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1094.583124] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.583427] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.583427] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.583547] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.583634] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.583725] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 397559b2-3c5a-424d-b09d-43a25d2abba6 is going to be created. [ 1094.605066] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.605233] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.605298] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.605494] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.605646] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.614845] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 397559b2-3c5a-424d-b09d-43a25d2abba6 in Status: UNINITIALIZED for 2s [ 1095.579843] env[69188]: INFO networking_nsxv3.common.synchronization [req-8d7a1448-cd96-4ae6-a32f-c5e0716e3836 req-92645398-f64d-4b5a-be4a-acfad8ab564a tempest-AttachInterfacesTestJSON-1255877948 tempest-AttachInterfacesTestJSON-1255877948-project-member] Enqueued Resource ID: 0ba9367f-1279-4e82-9eaa-4519ee3a1efb with Priority: HIGHEST for action security_group_members [ 1095.580127] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0ba9367f-1279-4e82-9eaa-4519ee3a1efb with Priority: HIGHEST for action security_group_members [ 1095.580480] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-0ba9367f-1279-4e82-9eaa-4519ee3a1efb taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.580637] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0ba9367f-1279-4e82-9eaa-4519ee3a1efb" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.580713] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0ba9367f-1279-4e82-9eaa-4519ee3a1efb" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.580981] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0ba9367f-1279-4e82-9eaa-4519ee3a1efb" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.581596] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.581723] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.581789] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.581970] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.582095] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.582223] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0ba9367f-1279-4e82-9eaa-4519ee3a1efb',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1096.086915] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.087243] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.087243] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.087765] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.087765] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.087765] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.088012] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.088012] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.088202] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.088339] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.088475] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0ba9367f-1279-4e82-9eaa-4519ee3a1efb already deleted. [ 1096.088607] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0ba9367f-1279-4e82-9eaa-4519ee3a1efb" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.204048] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock network-51 taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.204048] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "network-51" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.204048] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "network-51" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.204048] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "network-51" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.204048] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.204331] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.204331] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.204471] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.204617] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.204822] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1096.204938] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] NeedRegenerationException {{(pid=69188) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1096.205221] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] no value, waiting for create lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1096.205380] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] value creation lock acquired {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1096.205503] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1096.205614] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Calling creation function for not-yet-present value {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1096.205750] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1096.225221] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1096.225402] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69188) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1096.225544] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Released creation lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1096.225736] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "network-51" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.226043] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock port-38d204be-279b-425c-b8bc-1a606fa5c34f taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.226305] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "port-38d204be-279b-425c-b8bc-1a606fa5c34f" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.226649] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "port-38d204be-279b-425c-b8bc-1a606fa5c34f" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.226810] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "port-38d204be-279b-425c-b8bc-1a606fa5c34f" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.226983] env[69188]: DEBUG networking_nsxv3.api.rpc [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('38d204be-279b-425c-b8bc-1a606fa5c34f',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1096.624068] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 397559b2-3c5a-424d-b09d-43a25d2abba6 in Status: SUCCESS [ 1096.624295] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-397559b2-3c5a-424d-b09d-43a25d2abba6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.624448] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-397559b2-3c5a-424d-b09d-43a25d2abba6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.624657] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-397559b2-3c5a-424d-b09d-43a25d2abba6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.624854] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.624986] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.625044] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.625188] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.625272] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.625352] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-397559b2-3c5a-424d-b09d-43a25d2abba6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.625441] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('397559b2-3c5a-424d-b09d-43a25d2abba6',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1096.732102] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.732102] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.732102] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.732320] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.732497] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.732667] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Segment Port 38d204be-279b-425c-b8bc-1a606fa5c34f not found, creating... [ 1096.732938] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.733119] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.733325] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.733458] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.733599] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.733907] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.734090] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.734215] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.734429] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.734561] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.734701] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Resource: SegmentPort with ID: 38d204be-279b-425c-b8bc-1a606fa5c34f is going to be created. [ 1096.757312] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.757560] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.757708] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.758019] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.758295] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.758532] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "port-38d204be-279b-425c-b8bc-1a606fa5c34f" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.127691] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-397559b2-3c5a-424d-b09d-43a25d2abba6 taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.127978] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-397559b2-3c5a-424d-b09d-43a25d2abba6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.127978] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-397559b2-3c5a-424d-b09d-43a25d2abba6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.128201] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-397559b2-3c5a-424d-b09d-43a25d2abba6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.128499] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.128601] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.128671] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.128829] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.128918] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.129017] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-397559b2-3c5a-424d-b09d-43a25d2abba6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.129174] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-397559b2-3c5a-424d-b09d-43a25d2abba6 taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.129308] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-397559b2-3c5a-424d-b09d-43a25d2abba6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.129388] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-397559b2-3c5a-424d-b09d-43a25d2abba6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.129535] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-397559b2-3c5a-424d-b09d-43a25d2abba6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.129677] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.129769] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.129831] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.129966] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.130052] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.130172] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-397559b2-3c5a-424d-b09d-43a25d2abba6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.130873] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('397559b2-3c5a-424d-b09d-43a25d2abba6',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1097.635348] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 397559b2-3c5a-424d-b09d-43a25d2abba6: rpc.has_security_group_logging(os_id): False [ 1097.652233] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.652418] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.652470] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.652646] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.652736] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.652946] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.653054] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.653116] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.653305] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.653417] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.653612] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.653708] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.653854] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.653904] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.653978] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.654167] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.654262] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.654322] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.654459] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.654532] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.654617] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 397559b2-3c5a-424d-b09d-43a25d2abba6 is going to be created. [ 1097.725364] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.725532] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.725576] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.725776] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.725950] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.737296] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 397559b2-3c5a-424d-b09d-43a25d2abba6 in Status: IN_PROGRESS for 2s [ 1098.048130] env[69188]: INFO networking_nsxv3.common.synchronization [req-8d7a1448-cd96-4ae6-a32f-c5e0716e3836 req-e72a211a-ff7b-4bbe-8498-ef32f62feea2 service nova] Enqueued Resource ID: 0ba9367f-1279-4e82-9eaa-4519ee3a1efb with Priority: HIGHEST for action security_group_rules [ 1098.048368] env[69188]: INFO networking_nsxv3.common.synchronization [req-8d7a1448-cd96-4ae6-a32f-c5e0716e3836 req-e72a211a-ff7b-4bbe-8498-ef32f62feea2 service nova] Enqueued Resource ID: 0ba9367f-1279-4e82-9eaa-4519ee3a1efb with Priority: HIGHEST for action security_group_members [ 1098.048514] env[69188]: INFO networking_nsxv3.common.synchronization [req-8d7a1448-cd96-4ae6-a32f-c5e0716e3836 req-e72a211a-ff7b-4bbe-8498-ef32f62feea2 service nova] Enqueued Resource ID: 38d204be-279b-425c-b8bc-1a606fa5c34f with Priority: HIGHEST for action port [ 1098.049023] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0ba9367f-1279-4e82-9eaa-4519ee3a1efb with Priority: HIGHEST for action security_group_rules [ 1098.049158] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0ba9367f-1279-4e82-9eaa-4519ee3a1efb with Priority: HIGHEST for action security_group_members [ 1098.049285] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 38d204be-279b-425c-b8bc-1a606fa5c34f with Priority: HIGHEST for action port [ 1098.049560] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0ba9367f-1279-4e82-9eaa-4519ee3a1efb taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.049638] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0ba9367f-1279-4e82-9eaa-4519ee3a1efb" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.049704] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0ba9367f-1279-4e82-9eaa-4519ee3a1efb" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.049905] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0ba9367f-1279-4e82-9eaa-4519ee3a1efb" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.049985] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0ba9367f-1279-4e82-9eaa-4519ee3a1efb',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1098.051345] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-0ba9367f-1279-4e82-9eaa-4519ee3a1efb taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.051467] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0ba9367f-1279-4e82-9eaa-4519ee3a1efb" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.051516] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0ba9367f-1279-4e82-9eaa-4519ee3a1efb" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.051814] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0ba9367f-1279-4e82-9eaa-4519ee3a1efb" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.051943] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.052079] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.052126] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.052279] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.052416] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.052558] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0ba9367f-1279-4e82-9eaa-4519ee3a1efb',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1098.054437] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-38d204be-279b-425c-b8bc-1a606fa5c34f taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.054437] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-38d204be-279b-425c-b8bc-1a606fa5c34f" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.054437] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-38d204be-279b-425c-b8bc-1a606fa5c34f" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.054437] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-38d204be-279b-425c-b8bc-1a606fa5c34f" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.054437] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('38d204be-279b-425c-b8bc-1a606fa5c34f',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1098.556229] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-0ba9367f-1279-4e82-9eaa-4519ee3a1efb taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.556557] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0ba9367f-1279-4e82-9eaa-4519ee3a1efb" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.556650] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0ba9367f-1279-4e82-9eaa-4519ee3a1efb',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1098.560373] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 38d204be-279b-425c-b8bc-1a606fa5c34f with status ACTIVE [ 1098.560373] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.560373] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.560373] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.560373] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.560373] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.560373] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.560373] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.560373] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.560373] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.560373] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.560373] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.560373] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.560960] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.560960] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.560960] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.560960] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 38d204be-279b-425c-b8bc-1a606fa5c34f is going to be updated. [ 1098.590488] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.590698] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.590698] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.590895] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.591044] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.591243] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-38d204be-279b-425c-b8bc-1a606fa5c34f" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.687786] env[69188]: INFO networking_nsxv3.common.synchronization [req-af353f79-6742-4a1e-8a30-25c995feaa96 req-63a5ad57-88ed-4ffe-a01d-cf43034da124 tempest-ServersTestManualDisk-291117102 tempest-ServersTestManualDisk-291117102-project-member] Enqueued Resource ID: 6551850f-c3f5-470f-b5eb-f7d542ab3a90 with Priority: HIGHEST for action security_group_members [ 1098.688308] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6551850f-c3f5-470f-b5eb-f7d542ab3a90 with Priority: HIGHEST for action security_group_members [ 1098.688612] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-6551850f-c3f5-470f-b5eb-f7d542ab3a90 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.688738] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6551850f-c3f5-470f-b5eb-f7d542ab3a90" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.688804] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6551850f-c3f5-470f-b5eb-f7d542ab3a90" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.689008] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6551850f-c3f5-470f-b5eb-f7d542ab3a90" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.689629] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.689629] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.689629] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.689629] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.689827] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.689827] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6551850f-c3f5-470f-b5eb-f7d542ab3a90',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1099.059945] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0ba9367f-1279-4e82-9eaa-4519ee3a1efb',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1099.196555] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.196727] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.196767] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.196998] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.197120] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.197349] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.197452] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.197512] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.197669] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.197749] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.197837] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6551850f-c3f5-470f-b5eb-f7d542ab3a90 is going to be updated. [ 1099.221538] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.221631] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.221706] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.221941] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.222057] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.229450] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6551850f-c3f5-470f-b5eb-f7d542ab3a90 in Status: IN_PROGRESS for 2s [ 1099.561615] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.561944] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.561944] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.562161] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.562258] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.562363] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0ba9367f-1279-4e82-9eaa-4519ee3a1efb is going to be created. [ 1099.584874] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.585054] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.585140] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.585401] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.585573] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.594480] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0ba9367f-1279-4e82-9eaa-4519ee3a1efb in Status: UNINITIALIZED for 2s [ 1099.765795] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 397559b2-3c5a-424d-b09d-43a25d2abba6 in Status: SUCCESS [ 1099.766032] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-397559b2-3c5a-424d-b09d-43a25d2abba6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.239321] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6551850f-c3f5-470f-b5eb-f7d542ab3a90 in Status: SUCCESS [ 1101.239321] env[69188]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6551850f-c3f5-470f-b5eb-f7d542ab3a90 deletion is rescheduled due to dependency. [ 1101.239321] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6551850f-c3f5-470f-b5eb-f7d542ab3a90" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.611148] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0ba9367f-1279-4e82-9eaa-4519ee3a1efb in Status: SUCCESS [ 1101.611148] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0ba9367f-1279-4e82-9eaa-4519ee3a1efb" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.611148] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0ba9367f-1279-4e82-9eaa-4519ee3a1efb" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.611148] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0ba9367f-1279-4e82-9eaa-4519ee3a1efb" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.611148] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.611148] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.611148] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.611507] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.611507] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.611507] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0ba9367f-1279-4e82-9eaa-4519ee3a1efb" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.611639] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0ba9367f-1279-4e82-9eaa-4519ee3a1efb',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1102.114166] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0ba9367f-1279-4e82-9eaa-4519ee3a1efb',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1102.616906] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0ba9367f-1279-4e82-9eaa-4519ee3a1efb: rpc.has_security_group_logging(os_id): False [ 1102.636700] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.636896] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.636939] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.637190] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.637285] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.637539] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.637642] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.637708] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.637868] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.637947] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.638065] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0ba9367f-1279-4e82-9eaa-4519ee3a1efb is going to be created. [ 1102.696562] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.696739] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.696800] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.697021] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.697760] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.708270] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0ba9367f-1279-4e82-9eaa-4519ee3a1efb in Status: IN_PROGRESS for 2s [ 1103.689299] env[69188]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1103.689526] env[69188]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1104.483301] env[69188]: INFO networking_nsxv3.common.synchronization [None req-e61a83ea-9f44-4bbb-9e5b-e4ce7e62cd32 None None] Enqueued Resource ID: 41ad76b1-fd2d-4f72-a6cd-792a17104d43 with Priority: HIGHEST for action port [ 1104.483301] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 41ad76b1-fd2d-4f72-a6cd-792a17104d43 with Priority: HIGHEST for action port [ 1104.483301] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-41ad76b1-fd2d-4f72-a6cd-792a17104d43 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.486132] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-41ad76b1-fd2d-4f72-a6cd-792a17104d43" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.486236] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-41ad76b1-fd2d-4f72-a6cd-792a17104d43" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.486535] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-41ad76b1-fd2d-4f72-a6cd-792a17104d43" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.486627] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('41ad76b1-fd2d-4f72-a6cd-792a17104d43',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1104.720566] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0ba9367f-1279-4e82-9eaa-4519ee3a1efb in Status: SUCCESS [ 1104.721141] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0ba9367f-1279-4e82-9eaa-4519ee3a1efb" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.975725] env[69188]: INFO networking_nsxv3.common.synchronization [req-6a8aa7b0-64fd-433f-912a-d37fb9c29274 req-bebba42b-e9dc-4bed-8780-b6ec1e74056c tempest-ServerActionsTestJSON-1027345226 tempest-ServerActionsTestJSON-1027345226-project-member] Enqueued Resource ID: 9482bec7-7d68-4fe1-8d77-d380c3f6dc7a with Priority: HIGHEST for action security_group_members [ 1104.976276] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9482bec7-7d68-4fe1-8d77-d380c3f6dc7a with Priority: HIGHEST for action security_group_members [ 1104.978074] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-9482bec7-7d68-4fe1-8d77-d380c3f6dc7a taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.978074] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9482bec7-7d68-4fe1-8d77-d380c3f6dc7a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.978074] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9482bec7-7d68-4fe1-8d77-d380c3f6dc7a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.978074] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9482bec7-7d68-4fe1-8d77-d380c3f6dc7a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.978074] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.978074] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.978074] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.978074] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.978074] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.978074] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9482bec7-7d68-4fe1-8d77-d380c3f6dc7a',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1104.989857] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 41ad76b1-fd2d-4f72-a6cd-792a17104d43 [ 1104.990093] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.992071] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.992071] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.992071] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.992071] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.992071] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:41ad76b1-fd2d-4f72-a6cd-792a17104d43 already deleted. [ 1104.992071] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-41ad76b1-fd2d-4f72-a6cd-792a17104d43" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.479386] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.479386] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.479591] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.479669] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.501840] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.501840] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.501840] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.502100] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.502138] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.502270] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.502325] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9482bec7-7d68-4fe1-8d77-d380c3f6dc7a is going to be updated. [ 1105.527258] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.527551] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.527551] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.528152] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.528152] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.536860] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9482bec7-7d68-4fe1-8d77-d380c3f6dc7a in Status: IN_PROGRESS for 2s [ 1106.004796] env[69188]: INFO networking_nsxv3.common.synchronization [req-32bb9f24-2590-47e6-a360-a8fd94c999a7 req-55f04175-0f55-4c4c-9283-4f09e8cb23ad tempest-ServerDiskConfigTestJSON-1476779099 tempest-ServerDiskConfigTestJSON-1476779099-project-member] Enqueued Resource ID: 24a7b083-b432-46d6-94de-76adf6ce22b3 with Priority: HIGHEST for action security_group_members [ 1106.005455] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 24a7b083-b432-46d6-94de-76adf6ce22b3 with Priority: HIGHEST for action security_group_members [ 1106.005659] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-24a7b083-b432-46d6-94de-76adf6ce22b3 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.005779] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-24a7b083-b432-46d6-94de-76adf6ce22b3" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.005847] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-24a7b083-b432-46d6-94de-76adf6ce22b3" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.006059] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-24a7b083-b432-46d6-94de-76adf6ce22b3" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.006273] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.006380] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.006443] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.006592] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.006677] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.006769] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('24a7b083-b432-46d6-94de-76adf6ce22b3',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.418704] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock network-907 taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.418857] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "network-907" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.418979] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "network-907" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.419272] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "network-907" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.419522] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.419677] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.419793] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.420662] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.420662] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.420662] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1106.420662] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] NeedRegenerationException {{(pid=69188) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1106.420887] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] no value, waiting for create lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1106.420887] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] value creation lock acquired {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1106.421007] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1106.421100] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Calling creation function for not-yet-present value {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1106.421242] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1106.439100] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1106.439100] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69188) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1106.439245] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Released creation lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1106.439318] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "network-907" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.439632] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock port-c382513f-c2dd-4328-970b-56c8b8604931 taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.439805] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "port-c382513f-c2dd-4328-970b-56c8b8604931" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.439924] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "port-c382513f-c2dd-4328-970b-56c8b8604931" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.440327] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "port-c382513f-c2dd-4328-970b-56c8b8604931" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.440477] env[69188]: DEBUG networking_nsxv3.api.rpc [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c382513f-c2dd-4328-970b-56c8b8604931',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.509382] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.510126] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.510205] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.510496] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.510599] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.510971] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.510971] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.510971] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.511143] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.511224] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.511354] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 24a7b083-b432-46d6-94de-76adf6ce22b3 is going to be updated. [ 1106.535337] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.536024] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.536161] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.536474] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.537445] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.549206] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 24a7b083-b432-46d6-94de-76adf6ce22b3 in Status: IN_PROGRESS for 2s [ 1106.688236] env[69188]: INFO networking_nsxv3.common.synchronization [None req-f8ae401b-64e1-498e-b7f2-5205c5a613fa None None] Enqueued Resource ID: 6aded02f-8359-4359-9c56-c8d778790e89 with Priority: HIGHEST for action port [ 1106.689484] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6aded02f-8359-4359-9c56-c8d778790e89 with Priority: HIGHEST for action port [ 1106.692767] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-6aded02f-8359-4359-9c56-c8d778790e89 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.692767] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6aded02f-8359-4359-9c56-c8d778790e89" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.692767] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6aded02f-8359-4359-9c56-c8d778790e89" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.694395] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6aded02f-8359-4359-9c56-c8d778790e89" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.694395] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6aded02f-8359-4359-9c56-c8d778790e89',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.943859] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.944557] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.945000] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.945833] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.946380] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.946380] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Segment Port c382513f-c2dd-4328-970b-56c8b8604931 not found, creating... [ 1106.946585] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.946792] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.947056] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.947283] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.947519] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.947814] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.948040] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.948226] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.948524] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.948742] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.948742] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Resource: SegmentPort with ID: c382513f-c2dd-4328-970b-56c8b8604931 is going to be created. [ 1106.967907] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.968531] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.968531] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.968656] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.968889] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.969134] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "port-c382513f-c2dd-4328-970b-56c8b8604931" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.196527] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6aded02f-8359-4359-9c56-c8d778790e89 [ 1107.196804] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.196917] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.196986] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.197223] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.197318] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.197416] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6aded02f-8359-4359-9c56-c8d778790e89 already deleted. [ 1107.197498] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6aded02f-8359-4359-9c56-c8d778790e89" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.545804] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9482bec7-7d68-4fe1-8d77-d380c3f6dc7a in Status: SUCCESS [ 1107.545994] env[69188]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9482bec7-7d68-4fe1-8d77-d380c3f6dc7a deletion is rescheduled due to dependency. [ 1107.546121] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9482bec7-7d68-4fe1-8d77-d380c3f6dc7a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.241073] env[69188]: INFO networking_nsxv3.common.synchronization [req-32bb9f24-2590-47e6-a360-a8fd94c999a7 req-198d3451-85ea-47ca-92c2-43d5b830fe0f service nova] Enqueued Resource ID: 24a7b083-b432-46d6-94de-76adf6ce22b3 with Priority: HIGHEST for action security_group_rules [ 1108.241073] env[69188]: INFO networking_nsxv3.common.synchronization [req-32bb9f24-2590-47e6-a360-a8fd94c999a7 req-198d3451-85ea-47ca-92c2-43d5b830fe0f service nova] Enqueued Resource ID: 24a7b083-b432-46d6-94de-76adf6ce22b3 with Priority: HIGHEST for action security_group_members [ 1108.241073] env[69188]: INFO networking_nsxv3.common.synchronization [req-32bb9f24-2590-47e6-a360-a8fd94c999a7 req-198d3451-85ea-47ca-92c2-43d5b830fe0f service nova] Enqueued Resource ID: c382513f-c2dd-4328-970b-56c8b8604931 with Priority: HIGHEST for action port [ 1108.241073] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 24a7b083-b432-46d6-94de-76adf6ce22b3 with Priority: HIGHEST for action security_group_rules [ 1108.241073] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 24a7b083-b432-46d6-94de-76adf6ce22b3 with Priority: HIGHEST for action security_group_members [ 1108.241073] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c382513f-c2dd-4328-970b-56c8b8604931 with Priority: HIGHEST for action port [ 1108.241915] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-24a7b083-b432-46d6-94de-76adf6ce22b3 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.242218] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-24a7b083-b432-46d6-94de-76adf6ce22b3" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.242390] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-24a7b083-b432-46d6-94de-76adf6ce22b3" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.242702] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-24a7b083-b432-46d6-94de-76adf6ce22b3" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.243108] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('24a7b083-b432-46d6-94de-76adf6ce22b3',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1108.244240] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-24a7b083-b432-46d6-94de-76adf6ce22b3 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.244855] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-24a7b083-b432-46d6-94de-76adf6ce22b3" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.244855] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-c382513f-c2dd-4328-970b-56c8b8604931 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.246840] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c382513f-c2dd-4328-970b-56c8b8604931" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.246840] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c382513f-c2dd-4328-970b-56c8b8604931" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.246840] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c382513f-c2dd-4328-970b-56c8b8604931" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.246840] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c382513f-c2dd-4328-970b-56c8b8604931',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1108.628708] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 24a7b083-b432-46d6-94de-76adf6ce22b3 in Status: SUCCESS [ 1108.629097] env[69188]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 24a7b083-b432-46d6-94de-76adf6ce22b3 deletion is rescheduled due to dependency. [ 1108.629097] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-24a7b083-b432-46d6-94de-76adf6ce22b3" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.629268] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-24a7b083-b432-46d6-94de-76adf6ce22b3" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.629453] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-24a7b083-b432-46d6-94de-76adf6ce22b3" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.629643] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.629782] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.629859] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.629989] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.630083] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.630185] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('24a7b083-b432-46d6-94de-76adf6ce22b3',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1108.747211] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-24a7b083-b432-46d6-94de-76adf6ce22b3 taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.747349] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-24a7b083-b432-46d6-94de-76adf6ce22b3" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.749725] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c382513f-c2dd-4328-970b-56c8b8604931 with status ACTIVE [ 1108.750673] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.750673] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.750673] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.750673] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.750673] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.750673] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.750673] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.750994] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.750994] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.750994] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.751159] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.751499] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.751499] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.751499] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.751643] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.751643] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c382513f-c2dd-4328-970b-56c8b8604931 is going to be updated. [ 1108.774512] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.774642] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.774778] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.774909] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.775050] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.775205] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c382513f-c2dd-4328-970b-56c8b8604931" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.980718] env[69188]: INFO networking_nsxv3.common.synchronization [req-b8f923ba-4e3d-4799-8fbe-4543c0aba6d1 req-cc7b45a8-82fb-49dc-9490-d76ca15d185b tempest-ServersTestJSON-1495057482 tempest-ServersTestJSON-1495057482-project-member] Enqueued Resource ID: 9f2518e8-b195-4520-b262-caa765ab7e27 with Priority: HIGHEST for action security_group_members [ 1108.981409] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f2518e8-b195-4520-b262-caa765ab7e27 with Priority: HIGHEST for action security_group_members [ 1108.981654] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-9f2518e8-b195-4520-b262-caa765ab7e27 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.981738] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9f2518e8-b195-4520-b262-caa765ab7e27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.981778] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9f2518e8-b195-4520-b262-caa765ab7e27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.981967] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9f2518e8-b195-4520-b262-caa765ab7e27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.982202] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.982299] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.982366] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.982519] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.982603] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.982695] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9f2518e8-b195-4520-b262-caa765ab7e27',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1109.132183] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('24a7b083-b432-46d6-94de-76adf6ce22b3',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1109.342955] env[69188]: INFO networking_nsxv3.common.synchronization [None req-58402aef-2723-4e56-a546-ae7f462ee5d0 None None] Enqueued Resource ID: ed48beb5-b4ed-4431-8089-c0357d70344e with Priority: HIGHEST for action port [ 1109.343750] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ed48beb5-b4ed-4431-8089-c0357d70344e with Priority: HIGHEST for action port [ 1109.344048] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-ed48beb5-b4ed-4431-8089-c0357d70344e taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.344181] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ed48beb5-b4ed-4431-8089-c0357d70344e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.344246] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ed48beb5-b4ed-4431-8089-c0357d70344e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.345212] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ed48beb5-b4ed-4431-8089-c0357d70344e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.345212] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ed48beb5-b4ed-4431-8089-c0357d70344e',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1109.481701] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock network-507 taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.481952] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "network-507" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.482612] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "network-507" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.482612] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "network-507" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.482801] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.482895] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.482961] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.485320] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.485320] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.485320] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1109.485320] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] NeedRegenerationException {{(pid=69188) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1109.485320] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] no value, waiting for create lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1109.485320] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] value creation lock acquired {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1109.485320] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1109.485320] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Calling creation function for not-yet-present value {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1109.485320] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1109.486519] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9f2518e8-b195-4520-b262-caa765ab7e27',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1109.504245] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1109.504398] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69188) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1109.504483] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Released creation lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1109.504645] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "network-507" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.504973] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock port-72056dd0-c5c4-4e69-9736-2122519d5879 taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.505148] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "port-72056dd0-c5c4-4e69-9736-2122519d5879" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.505275] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "port-72056dd0-c5c4-4e69-9736-2122519d5879" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.506037] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "port-72056dd0-c5c4-4e69-9736-2122519d5879" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.506037] env[69188]: DEBUG networking_nsxv3.api.rpc [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('72056dd0-c5c4-4e69-9736-2122519d5879',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1109.634932] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('24a7b083-b432-46d6-94de-76adf6ce22b3',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1109.846999] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ed48beb5-b4ed-4431-8089-c0357d70344e [ 1109.847263] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.847401] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.847510] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.847689] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.847781] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.847894] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ed48beb5-b4ed-4431-8089-c0357d70344e already deleted. [ 1109.847941] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ed48beb5-b4ed-4431-8089-c0357d70344e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.989037] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9f2518e8-b195-4520-b262-caa765ab7e27',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1110.010060] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.010366] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.010515] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.010974] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.010974] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.011397] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Segment Port 72056dd0-c5c4-4e69-9736-2122519d5879 not found, creating... [ 1110.011471] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.011713] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.011806] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.012162] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.012235] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.013110] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.013110] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.013110] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.013110] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.013110] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.013509] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Resource: SegmentPort with ID: 72056dd0-c5c4-4e69-9736-2122519d5879 is going to be created. [ 1110.034709] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.034916] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.035049] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.035318] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.035577] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.035807] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "port-72056dd0-c5c4-4e69-9736-2122519d5879" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.136886] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.137148] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.137148] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.137352] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.137442] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.137539] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 24a7b083-b432-46d6-94de-76adf6ce22b3 is going to be updated. [ 1110.167242] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.167415] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.167468] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.167714] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.167869] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.194615] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 24a7b083-b432-46d6-94de-76adf6ce22b3 in Status: IN_PROGRESS for 2s [ 1110.490822] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.491157] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.491157] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.491286] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.491385] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.491840] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9f2518e8-b195-4520-b262-caa765ab7e27 is going to be updated. [ 1110.519586] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.519730] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.519796] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.520014] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.520160] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.531273] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9f2518e8-b195-4520-b262-caa765ab7e27 in Status: IN_PROGRESS for 2s [ 1110.971244] env[69188]: INFO networking_nsxv3.common.synchronization [req-b8f923ba-4e3d-4799-8fbe-4543c0aba6d1 req-a9f9c073-63ff-4dc3-83fb-a9147d42c076 service nova] Enqueued Resource ID: 9f2518e8-b195-4520-b262-caa765ab7e27 with Priority: HIGHEST for action security_group_rules [ 1110.971434] env[69188]: INFO networking_nsxv3.common.synchronization [req-b8f923ba-4e3d-4799-8fbe-4543c0aba6d1 req-a9f9c073-63ff-4dc3-83fb-a9147d42c076 service nova] Enqueued Resource ID: 9f2518e8-b195-4520-b262-caa765ab7e27 with Priority: HIGHEST for action security_group_members [ 1110.971588] env[69188]: INFO networking_nsxv3.common.synchronization [req-b8f923ba-4e3d-4799-8fbe-4543c0aba6d1 req-a9f9c073-63ff-4dc3-83fb-a9147d42c076 service nova] Enqueued Resource ID: 72056dd0-c5c4-4e69-9736-2122519d5879 with Priority: HIGHEST for action port [ 1110.971813] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f2518e8-b195-4520-b262-caa765ab7e27 with Priority: HIGHEST for action security_group_rules [ 1110.971937] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f2518e8-b195-4520-b262-caa765ab7e27 with Priority: HIGHEST for action security_group_members [ 1110.972042] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 72056dd0-c5c4-4e69-9736-2122519d5879 with Priority: HIGHEST for action port [ 1110.972583] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9f2518e8-b195-4520-b262-caa765ab7e27 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.972704] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9f2518e8-b195-4520-b262-caa765ab7e27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.972766] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9f2518e8-b195-4520-b262-caa765ab7e27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.972976] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9f2518e8-b195-4520-b262-caa765ab7e27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.974160] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9f2518e8-b195-4520-b262-caa765ab7e27',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1110.975766] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-9f2518e8-b195-4520-b262-caa765ab7e27 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.975855] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9f2518e8-b195-4520-b262-caa765ab7e27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.977301] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-72056dd0-c5c4-4e69-9736-2122519d5879 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.977301] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-72056dd0-c5c4-4e69-9736-2122519d5879" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.977301] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-72056dd0-c5c4-4e69-9736-2122519d5879" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.977301] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-72056dd0-c5c4-4e69-9736-2122519d5879" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.977301] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('72056dd0-c5c4-4e69-9736-2122519d5879',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1111.478089] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-9f2518e8-b195-4520-b262-caa765ab7e27 taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.478204] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9f2518e8-b195-4520-b262-caa765ab7e27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.478597] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 72056dd0-c5c4-4e69-9736-2122519d5879 with status ACTIVE [ 1111.478597] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.478806] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.478806] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.479064] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.479594] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.479594] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.479594] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.479594] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.479779] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.479779] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.479951] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.480051] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.483017] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.483017] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.483017] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.483017] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 72056dd0-c5c4-4e69-9736-2122519d5879 is going to be updated. [ 1111.491488] env[69188]: INFO networking_nsxv3.common.synchronization [None req-145a1e71-3f9c-4819-8d40-011181dc0aea None None] Enqueued Resource ID: ec018cdb-6b88-496b-95d4-7849c724fd1a with Priority: HIGHEST for action port [ 1111.491738] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ec018cdb-6b88-496b-95d4-7849c724fd1a with Priority: HIGHEST for action port [ 1111.492292] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-ec018cdb-6b88-496b-95d4-7849c724fd1a taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.492414] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ec018cdb-6b88-496b-95d4-7849c724fd1a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.492482] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ec018cdb-6b88-496b-95d4-7849c724fd1a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.492745] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ec018cdb-6b88-496b-95d4-7849c724fd1a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.492832] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ec018cdb-6b88-496b-95d4-7849c724fd1a',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1111.500280] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.500422] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.500492] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.500681] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.500815] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.500989] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-72056dd0-c5c4-4e69-9736-2122519d5879" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.998761] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ec018cdb-6b88-496b-95d4-7849c724fd1a [ 1111.998761] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.998761] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.998761] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.998761] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.998761] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.999063] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ec018cdb-6b88-496b-95d4-7849c724fd1a already deleted. [ 1111.999063] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ec018cdb-6b88-496b-95d4-7849c724fd1a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.203869] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 24a7b083-b432-46d6-94de-76adf6ce22b3 in Status: SUCCESS [ 1112.204108] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-24a7b083-b432-46d6-94de-76adf6ce22b3" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.204264] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-24a7b083-b432-46d6-94de-76adf6ce22b3" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.204479] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-24a7b083-b432-46d6-94de-76adf6ce22b3" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.204672] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.204786] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.204850] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.204999] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.205095] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.205178] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-24a7b083-b432-46d6-94de-76adf6ce22b3" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.205272] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('24a7b083-b432-46d6-94de-76adf6ce22b3',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1112.541177] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9f2518e8-b195-4520-b262-caa765ab7e27 in Status: SUCCESS [ 1112.541492] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9f2518e8-b195-4520-b262-caa765ab7e27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.541612] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9f2518e8-b195-4520-b262-caa765ab7e27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.542469] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9f2518e8-b195-4520-b262-caa765ab7e27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.542685] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.542806] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.542874] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.543501] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.543501] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.543501] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9f2518e8-b195-4520-b262-caa765ab7e27',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1112.710791] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-24a7b083-b432-46d6-94de-76adf6ce22b3 taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.710993] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-24a7b083-b432-46d6-94de-76adf6ce22b3" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.711058] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-24a7b083-b432-46d6-94de-76adf6ce22b3" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.711282] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-24a7b083-b432-46d6-94de-76adf6ce22b3" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.711467] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.711594] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.711823] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.711823] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.711905] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.711949] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-24a7b083-b432-46d6-94de-76adf6ce22b3" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.712108] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-24a7b083-b432-46d6-94de-76adf6ce22b3 taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.712204] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-24a7b083-b432-46d6-94de-76adf6ce22b3" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.712265] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-24a7b083-b432-46d6-94de-76adf6ce22b3" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.712403] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-24a7b083-b432-46d6-94de-76adf6ce22b3" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.712542] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.712632] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.712713] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.712847] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.712932] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.713009] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-24a7b083-b432-46d6-94de-76adf6ce22b3" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.713103] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('24a7b083-b432-46d6-94de-76adf6ce22b3',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1113.045867] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9f2518e8-b195-4520-b262-caa765ab7e27',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1113.215890] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 24a7b083-b432-46d6-94de-76adf6ce22b3: rpc.has_security_group_logging(os_id): False [ 1113.234343] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.234774] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.234774] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.235019] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.235172] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.235467] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.235625] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.235733] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.236101] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.236182] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.236461] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.236613] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.236720] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.236995] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.237097] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.237388] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.237545] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.237647] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.237866] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.237990] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.238140] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 24a7b083-b432-46d6-94de-76adf6ce22b3 is going to be updated. [ 1113.297123] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.297360] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.297475] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.297789] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.298105] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.312817] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 24a7b083-b432-46d6-94de-76adf6ce22b3 in Status: IN_PROGRESS for 2s [ 1113.548401] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9f2518e8-b195-4520-b262-caa765ab7e27',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1114.051174] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.051366] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.051441] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.051687] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.051783] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.052158] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9f2518e8-b195-4520-b262-caa765ab7e27 is going to be updated. [ 1114.077136] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.077295] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.077364] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.077526] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.077671] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.085726] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9f2518e8-b195-4520-b262-caa765ab7e27 in Status: IN_PROGRESS for 2s [ 1115.327887] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 24a7b083-b432-46d6-94de-76adf6ce22b3 in Status: SUCCESS [ 1115.328189] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-24a7b083-b432-46d6-94de-76adf6ce22b3" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.543547] env[69188]: INFO networking_nsxv3.common.synchronization [req-8d73d357-0c38-445c-82d3-56e24680270b req-a1fc370a-9675-4609-858e-13786acb2cee tempest-InstanceActionsNegativeTestJSON-1775938039 tempest-InstanceActionsNegativeTestJSON-1775938039-project-member] Enqueued Resource ID: 2240419a-b1eb-469c-b2f2-8c54a91fa4b9 with Priority: HIGHEST for action security_group_members [ 1115.544112] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2240419a-b1eb-469c-b2f2-8c54a91fa4b9 with Priority: HIGHEST for action security_group_members [ 1115.544412] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-2240419a-b1eb-469c-b2f2-8c54a91fa4b9 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.544534] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2240419a-b1eb-469c-b2f2-8c54a91fa4b9" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.544601] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2240419a-b1eb-469c-b2f2-8c54a91fa4b9" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.544861] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2240419a-b1eb-469c-b2f2-8c54a91fa4b9" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.545029] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.545133] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.545197] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.545345] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.545429] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.545521] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2240419a-b1eb-469c-b2f2-8c54a91fa4b9',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1115.805348] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock network-672 taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.807033] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "network-672" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.807033] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "network-672" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.807033] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "network-672" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.808599] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.809075] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.809240] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.809491] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.809679] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.809978] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1115.810160] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] NeedRegenerationException {{(pid=69188) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1115.810275] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] no value, waiting for create lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1115.810488] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] value creation lock acquired {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1115.811626] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1115.811626] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Calling creation function for not-yet-present value {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1115.811626] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1115.829078] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1115.829373] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69188) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1115.829587] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Released creation lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1115.829770] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "network-672" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.830121] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock port-a57a9824-907f-40a4-b84f-74ea06c0c4f5 taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.830314] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "port-a57a9824-907f-40a4-b84f-74ea06c0c4f5" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.830661] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "port-a57a9824-907f-40a4-b84f-74ea06c0c4f5" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.831290] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "port-a57a9824-907f-40a4-b84f-74ea06c0c4f5" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.831290] env[69188]: DEBUG networking_nsxv3.api.rpc [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a57a9824-907f-40a4-b84f-74ea06c0c4f5',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1116.050202] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.050202] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.050202] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.050202] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.050202] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.050202] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.050202] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.050202] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.050202] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.050202] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.050202] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2240419a-b1eb-469c-b2f2-8c54a91fa4b9 already deleted. [ 1116.050202] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2240419a-b1eb-469c-b2f2-8c54a91fa4b9" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.096155] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9f2518e8-b195-4520-b262-caa765ab7e27 in Status: SUCCESS [ 1116.096427] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9f2518e8-b195-4520-b262-caa765ab7e27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.096629] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9f2518e8-b195-4520-b262-caa765ab7e27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.096904] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9f2518e8-b195-4520-b262-caa765ab7e27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.097143] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.097275] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.097357] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.097515] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.097620] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.097733] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9f2518e8-b195-4520-b262-caa765ab7e27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.097833] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9f2518e8-b195-4520-b262-caa765ab7e27',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1116.335194] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.335538] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.335627] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.335957] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.336174] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.336356] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Segment Port a57a9824-907f-40a4-b84f-74ea06c0c4f5 not found, creating... [ 1116.336655] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.336857] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.337105] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.337487] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.337764] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.338323] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.338617] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.338838] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.339247] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.339524] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.339825] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Resource: SegmentPort with ID: a57a9824-907f-40a4-b84f-74ea06c0c4f5 is going to be created. [ 1116.360449] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.360762] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.360931] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.361484] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.361581] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.361835] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "port-a57a9824-907f-40a4-b84f-74ea06c0c4f5" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.600125] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-9f2518e8-b195-4520-b262-caa765ab7e27 taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.600323] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9f2518e8-b195-4520-b262-caa765ab7e27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.600367] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9f2518e8-b195-4520-b262-caa765ab7e27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.600635] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9f2518e8-b195-4520-b262-caa765ab7e27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.600804] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.600908] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.600974] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.601134] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.601224] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.601313] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9f2518e8-b195-4520-b262-caa765ab7e27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.601456] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-9f2518e8-b195-4520-b262-caa765ab7e27 taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.601550] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9f2518e8-b195-4520-b262-caa765ab7e27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.601609] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9f2518e8-b195-4520-b262-caa765ab7e27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.601748] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9f2518e8-b195-4520-b262-caa765ab7e27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.601878] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.601967] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.602042] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.602180] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.602286] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.602384] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9f2518e8-b195-4520-b262-caa765ab7e27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.602465] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9f2518e8-b195-4520-b262-caa765ab7e27',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.105118] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9f2518e8-b195-4520-b262-caa765ab7e27: rpc.has_security_group_logging(os_id): False [ 1117.124553] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.124553] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.124553] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.124553] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.141298] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.143020] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.143020] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.143020] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.143020] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.143020] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.143020] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.143020] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.143020] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.143020] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.143020] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.143726] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.143956] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.144162] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.145870] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.145870] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.145870] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9f2518e8-b195-4520-b262-caa765ab7e27 is going to be updated. [ 1117.203027] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.203027] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.203027] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.203027] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.203027] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.214338] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9f2518e8-b195-4520-b262-caa765ab7e27 in Status: IN_PROGRESS for 2s [ 1117.370823] env[69188]: INFO networking_nsxv3.common.synchronization [req-8d73d357-0c38-445c-82d3-56e24680270b req-10f0a067-4ed9-466d-afbf-4924f6115e64 service nova] Enqueued Resource ID: 2240419a-b1eb-469c-b2f2-8c54a91fa4b9 with Priority: HIGHEST for action security_group_rules [ 1117.370823] env[69188]: INFO networking_nsxv3.common.synchronization [req-8d73d357-0c38-445c-82d3-56e24680270b req-10f0a067-4ed9-466d-afbf-4924f6115e64 service nova] Enqueued Resource ID: 2240419a-b1eb-469c-b2f2-8c54a91fa4b9 with Priority: HIGHEST for action security_group_members [ 1117.370823] env[69188]: INFO networking_nsxv3.common.synchronization [req-8d73d357-0c38-445c-82d3-56e24680270b req-10f0a067-4ed9-466d-afbf-4924f6115e64 service nova] Enqueued Resource ID: a57a9824-907f-40a4-b84f-74ea06c0c4f5 with Priority: HIGHEST for action port [ 1117.370823] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2240419a-b1eb-469c-b2f2-8c54a91fa4b9 with Priority: HIGHEST for action security_group_rules [ 1117.370823] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2240419a-b1eb-469c-b2f2-8c54a91fa4b9 with Priority: HIGHEST for action security_group_members [ 1117.370823] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a57a9824-907f-40a4-b84f-74ea06c0c4f5 with Priority: HIGHEST for action port [ 1117.370823] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2240419a-b1eb-469c-b2f2-8c54a91fa4b9 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.370823] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2240419a-b1eb-469c-b2f2-8c54a91fa4b9" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.370823] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2240419a-b1eb-469c-b2f2-8c54a91fa4b9" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.373877] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2240419a-b1eb-469c-b2f2-8c54a91fa4b9" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.373877] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2240419a-b1eb-469c-b2f2-8c54a91fa4b9',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.374564] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-2240419a-b1eb-469c-b2f2-8c54a91fa4b9 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.375297] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2240419a-b1eb-469c-b2f2-8c54a91fa4b9" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.375297] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2240419a-b1eb-469c-b2f2-8c54a91fa4b9" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.375297] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2240419a-b1eb-469c-b2f2-8c54a91fa4b9" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.375297] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.375471] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.375471] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.375605] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.375717] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.375835] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2240419a-b1eb-469c-b2f2-8c54a91fa4b9',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.376954] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-a57a9824-907f-40a4-b84f-74ea06c0c4f5 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.377027] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a57a9824-907f-40a4-b84f-74ea06c0c4f5" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.377069] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a57a9824-907f-40a4-b84f-74ea06c0c4f5" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.377271] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a57a9824-907f-40a4-b84f-74ea06c0c4f5" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.377367] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a57a9824-907f-40a4-b84f-74ea06c0c4f5',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.879709] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2240419a-b1eb-469c-b2f2-8c54a91fa4b9',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.881280] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-2240419a-b1eb-469c-b2f2-8c54a91fa4b9 taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.881408] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2240419a-b1eb-469c-b2f2-8c54a91fa4b9" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.881572] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a57a9824-907f-40a4-b84f-74ea06c0c4f5 with status ACTIVE [ 1117.881727] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.881830] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.881890] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.882113] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.886020] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.886020] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.886020] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.886020] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.886020] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.886020] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.886020] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.886020] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.886020] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.886020] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.886020] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.886020] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a57a9824-907f-40a4-b84f-74ea06c0c4f5 is going to be updated. [ 1117.903821] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.903977] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.904036] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.904214] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.904346] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.904502] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a57a9824-907f-40a4-b84f-74ea06c0c4f5" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.010135] env[69188]: INFO networking_nsxv3.common.synchronization [req-e47065d7-df86-4a2c-af02-9342a84a4075 req-260ba014-cf0d-41a9-8e59-a9150c5af0bd tempest-ServerAddressesNegativeTestJSON-111320539 tempest-ServerAddressesNegativeTestJSON-111320539-project-member] Enqueued Resource ID: c7e4a274-48d0-4c86-9db6-5b72611db3e7 with Priority: HIGHEST for action security_group_members [ 1118.010135] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c7e4a274-48d0-4c86-9db6-5b72611db3e7 with Priority: HIGHEST for action security_group_members [ 1118.010135] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-c7e4a274-48d0-4c86-9db6-5b72611db3e7 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.010135] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c7e4a274-48d0-4c86-9db6-5b72611db3e7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.010135] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c7e4a274-48d0-4c86-9db6-5b72611db3e7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.010135] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c7e4a274-48d0-4c86-9db6-5b72611db3e7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.010470] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.010470] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.010470] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.010591] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.011667] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.011667] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c7e4a274-48d0-4c86-9db6-5b72611db3e7',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1118.364998] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock network-579 taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.365232] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "network-579" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.365472] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "network-579" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.365821] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "network-579" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.366112] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.366284] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.366485] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.366621] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.366772] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.366978] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1118.367645] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] NeedRegenerationException {{(pid=69188) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1118.367645] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] no value, waiting for create lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1118.367645] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] value creation lock acquired {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1118.367645] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1118.367645] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Calling creation function for not-yet-present value {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1118.367645] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1118.384771] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1118.385714] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69188) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1118.385820] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Released creation lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1118.385998] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "network-579" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.386331] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock port-7721916e-e8d2-4601-88ba-9ec80279ec3c taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.386511] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "port-7721916e-e8d2-4601-88ba-9ec80279ec3c" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.386636] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "port-7721916e-e8d2-4601-88ba-9ec80279ec3c" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.386941] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "port-7721916e-e8d2-4601-88ba-9ec80279ec3c" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.387095] env[69188]: DEBUG networking_nsxv3.api.rpc [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7721916e-e8d2-4601-88ba-9ec80279ec3c',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1118.388131] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2240419a-b1eb-469c-b2f2-8c54a91fa4b9',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1118.514882] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.515051] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.515123] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.515328] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.515419] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.515608] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.515701] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.515761] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.515900] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.516198] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.516198] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c7e4a274-48d0-4c86-9db6-5b72611db3e7 already deleted. [ 1118.516198] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c7e4a274-48d0-4c86-9db6-5b72611db3e7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.890164] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.890402] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.890558] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.890846] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.891012] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.891182] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Segment Port 7721916e-e8d2-4601-88ba-9ec80279ec3c not found, creating... [ 1118.891469] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.891658] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.891783] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.892010] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.892160] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.892449] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.892608] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.892728] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.892934] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.895340] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.895568] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Resource: SegmentPort with ID: 7721916e-e8d2-4601-88ba-9ec80279ec3c is going to be created. [ 1118.896799] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.896962] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.897071] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.897251] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.897356] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.897476] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2240419a-b1eb-469c-b2f2-8c54a91fa4b9 is going to be created. [ 1118.916728] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.916990] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.917144] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.917461] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.917695] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.917941] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "port-7721916e-e8d2-4601-88ba-9ec80279ec3c" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.919544] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.920220] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.920715] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.920951] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.921162] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.930509] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2240419a-b1eb-469c-b2f2-8c54a91fa4b9 in Status: UNINITIALIZED for 2s [ 1119.232105] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9f2518e8-b195-4520-b262-caa765ab7e27 in Status: SUCCESS [ 1119.232368] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9f2518e8-b195-4520-b262-caa765ab7e27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.735026] env[69188]: INFO networking_nsxv3.common.synchronization [req-e47065d7-df86-4a2c-af02-9342a84a4075 req-3ff546ee-ad7c-499f-b03c-109dfe5dc672 service nova] Enqueued Resource ID: c7e4a274-48d0-4c86-9db6-5b72611db3e7 with Priority: HIGHEST for action security_group_rules [ 1119.735026] env[69188]: INFO networking_nsxv3.common.synchronization [req-e47065d7-df86-4a2c-af02-9342a84a4075 req-3ff546ee-ad7c-499f-b03c-109dfe5dc672 service nova] Enqueued Resource ID: c7e4a274-48d0-4c86-9db6-5b72611db3e7 with Priority: HIGHEST for action security_group_members [ 1119.735026] env[69188]: INFO networking_nsxv3.common.synchronization [req-e47065d7-df86-4a2c-af02-9342a84a4075 req-3ff546ee-ad7c-499f-b03c-109dfe5dc672 service nova] Enqueued Resource ID: 7721916e-e8d2-4601-88ba-9ec80279ec3c with Priority: HIGHEST for action port [ 1119.735026] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c7e4a274-48d0-4c86-9db6-5b72611db3e7 with Priority: HIGHEST for action security_group_rules [ 1119.735026] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c7e4a274-48d0-4c86-9db6-5b72611db3e7 with Priority: HIGHEST for action security_group_members [ 1119.735026] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7721916e-e8d2-4601-88ba-9ec80279ec3c with Priority: HIGHEST for action port [ 1119.736228] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c7e4a274-48d0-4c86-9db6-5b72611db3e7 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.736498] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c7e4a274-48d0-4c86-9db6-5b72611db3e7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.736658] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c7e4a274-48d0-4c86-9db6-5b72611db3e7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.737153] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c7e4a274-48d0-4c86-9db6-5b72611db3e7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.738685] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c7e4a274-48d0-4c86-9db6-5b72611db3e7',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1119.738685] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-c7e4a274-48d0-4c86-9db6-5b72611db3e7 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.738685] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c7e4a274-48d0-4c86-9db6-5b72611db3e7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.738685] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c7e4a274-48d0-4c86-9db6-5b72611db3e7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.739109] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c7e4a274-48d0-4c86-9db6-5b72611db3e7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.739354] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.739588] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.739762] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.740032] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.740231] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.740559] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c7e4a274-48d0-4c86-9db6-5b72611db3e7',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1119.743141] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-7721916e-e8d2-4601-88ba-9ec80279ec3c taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.743141] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7721916e-e8d2-4601-88ba-9ec80279ec3c" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.743141] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7721916e-e8d2-4601-88ba-9ec80279ec3c" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.743141] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7721916e-e8d2-4601-88ba-9ec80279ec3c" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.743141] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7721916e-e8d2-4601-88ba-9ec80279ec3c',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1120.249712] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-c7e4a274-48d0-4c86-9db6-5b72611db3e7 taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.249712] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c7e4a274-48d0-4c86-9db6-5b72611db3e7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.250027] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c7e4a274-48d0-4c86-9db6-5b72611db3e7',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1120.250782] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7721916e-e8d2-4601-88ba-9ec80279ec3c with status ACTIVE [ 1120.250977] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.251143] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.251188] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.251410] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.251521] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.251721] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.251824] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.251886] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.252054] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.252469] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.252469] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.252469] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.252469] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.252729] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.252729] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.252812] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7721916e-e8d2-4601-88ba-9ec80279ec3c is going to be updated. [ 1120.276844] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.276844] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.276844] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.277146] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.277217] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.277597] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7721916e-e8d2-4601-88ba-9ec80279ec3c" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.419659] env[69188]: INFO networking_nsxv3.common.synchronization [req-6b92c673-0a99-48a1-9a84-0be00047a068 req-8dd56592-2b69-4ba4-bcdb-8f267b6b31fb tempest-ServerActionsTestJSON-1027345226 tempest-ServerActionsTestJSON-1027345226-project-member] Enqueued Resource ID: 9482bec7-7d68-4fe1-8d77-d380c3f6dc7a with Priority: HIGHEST for action security_group_members [ 1120.420118] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9482bec7-7d68-4fe1-8d77-d380c3f6dc7a with Priority: HIGHEST for action security_group_members [ 1120.420438] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-9482bec7-7d68-4fe1-8d77-d380c3f6dc7a taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.420610] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9482bec7-7d68-4fe1-8d77-d380c3f6dc7a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.420679] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9482bec7-7d68-4fe1-8d77-d380c3f6dc7a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.420881] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9482bec7-7d68-4fe1-8d77-d380c3f6dc7a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.422149] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.422445] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.422445] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.422655] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.422734] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.422858] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9482bec7-7d68-4fe1-8d77-d380c3f6dc7a',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1120.755073] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c7e4a274-48d0-4c86-9db6-5b72611db3e7',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1120.926318] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.926526] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.926638] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.926817] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.926926] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.927140] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.927281] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.927359] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.927504] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.927587] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.927702] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9482bec7-7d68-4fe1-8d77-d380c3f6dc7a is going to be updated. [ 1120.940497] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2240419a-b1eb-469c-b2f2-8c54a91fa4b9 in Status: SUCCESS [ 1120.940497] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2240419a-b1eb-469c-b2f2-8c54a91fa4b9" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.940497] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2240419a-b1eb-469c-b2f2-8c54a91fa4b9" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.940497] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2240419a-b1eb-469c-b2f2-8c54a91fa4b9" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.940497] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.940497] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.940497] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.940497] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.940497] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.941177] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2240419a-b1eb-469c-b2f2-8c54a91fa4b9" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.941177] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2240419a-b1eb-469c-b2f2-8c54a91fa4b9',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1120.950644] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.950804] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.950804] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.951024] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.951171] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.958953] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9482bec7-7d68-4fe1-8d77-d380c3f6dc7a in Status: IN_PROGRESS for 2s [ 1120.984319] env[69188]: INFO networking_nsxv3.common.synchronization [req-c9c3a809-0d35-4a90-a211-c6d339ecbc4a req-01a7e1d7-c15e-404f-b1e9-8ae0b577d9a0 tempest-ServerDiskConfigTestJSON-1476779099 tempest-ServerDiskConfigTestJSON-1476779099-project-member] Enqueued Resource ID: 24a7b083-b432-46d6-94de-76adf6ce22b3 with Priority: HIGHEST for action security_group_members [ 1120.984935] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 24a7b083-b432-46d6-94de-76adf6ce22b3 with Priority: HIGHEST for action security_group_members [ 1120.985272] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-24a7b083-b432-46d6-94de-76adf6ce22b3 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.985413] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-24a7b083-b432-46d6-94de-76adf6ce22b3" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.985480] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-24a7b083-b432-46d6-94de-76adf6ce22b3" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.985675] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-24a7b083-b432-46d6-94de-76adf6ce22b3" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.985831] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.985932] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.986010] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.986184] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.986271] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.986487] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('24a7b083-b432-46d6-94de-76adf6ce22b3',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1121.153923] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock network-859 taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.155123] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "network-859" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.155123] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "network-859" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.155123] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "network-859" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.155277] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.155429] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.155556] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.155815] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.155975] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.156208] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1121.156348] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] NeedRegenerationException {{(pid=69188) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1121.156472] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] no value, waiting for create lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1121.156587] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] value creation lock acquired {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1121.156702] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1121.156814] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Calling creation function for not-yet-present value {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1121.156954] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1121.174808] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1121.174963] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69188) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1121.175092] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Released creation lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1121.175283] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "network-859" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.175643] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock port-366d7d30-f68e-430a-a4ea-f50371cc210d taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.175834] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "port-366d7d30-f68e-430a-a4ea-f50371cc210d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.175958] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "port-366d7d30-f68e-430a-a4ea-f50371cc210d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.176372] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "port-366d7d30-f68e-430a-a4ea-f50371cc210d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.176548] env[69188]: DEBUG networking_nsxv3.api.rpc [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('366d7d30-f68e-430a-a4ea-f50371cc210d',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1121.258297] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.258520] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.258566] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.258793] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.258913] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.259019] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c7e4a274-48d0-4c86-9db6-5b72611db3e7 is going to be created. [ 1121.281509] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.281509] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.281748] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.281818] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.282022] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.290579] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c7e4a274-48d0-4c86-9db6-5b72611db3e7 in Status: UNINITIALIZED for 2s [ 1121.450715] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-2240419a-b1eb-469c-b2f2-8c54a91fa4b9 taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.450917] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2240419a-b1eb-469c-b2f2-8c54a91fa4b9" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.450971] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2240419a-b1eb-469c-b2f2-8c54a91fa4b9" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.451194] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2240419a-b1eb-469c-b2f2-8c54a91fa4b9" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.451412] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.451591] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.451712] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.452015] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.452124] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.452217] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2240419a-b1eb-469c-b2f2-8c54a91fa4b9" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.452482] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-2240419a-b1eb-469c-b2f2-8c54a91fa4b9 taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.452661] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2240419a-b1eb-469c-b2f2-8c54a91fa4b9" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.452775] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2240419a-b1eb-469c-b2f2-8c54a91fa4b9" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.453034] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2240419a-b1eb-469c-b2f2-8c54a91fa4b9" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.453222] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.453391] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.453500] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.453749] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.453895] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.453993] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2240419a-b1eb-469c-b2f2-8c54a91fa4b9" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.454097] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2240419a-b1eb-469c-b2f2-8c54a91fa4b9',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1121.488254] env[69188]: INFO networking_nsxv3.common.synchronization [req-6a2881d6-0ad1-4cae-8101-147fb61e2561 req-725edcc7-97c9-4d14-bf34-3a5fef5b9271 tempest-ServersTestJSON-1495057482 tempest-ServersTestJSON-1495057482-project-member] Enqueued Resource ID: 9f2518e8-b195-4520-b262-caa765ab7e27 with Priority: HIGHEST for action security_group_members [ 1121.490030] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f2518e8-b195-4520-b262-caa765ab7e27 with Priority: HIGHEST for action security_group_members [ 1121.490030] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-9f2518e8-b195-4520-b262-caa765ab7e27 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.490030] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9f2518e8-b195-4520-b262-caa765ab7e27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.490030] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9f2518e8-b195-4520-b262-caa765ab7e27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.490030] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9f2518e8-b195-4520-b262-caa765ab7e27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.490030] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.490612] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.490612] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.490612] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.490612] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.490612] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9f2518e8-b195-4520-b262-caa765ab7e27',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1121.491486] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.491612] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.491681] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.491834] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.491916] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.492099] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.492186] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.493621] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.493621] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.493621] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.493621] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 24a7b083-b432-46d6-94de-76adf6ce22b3 is going to be updated. [ 1121.519618] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.519618] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.519618] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.519618] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.519771] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.527714] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 24a7b083-b432-46d6-94de-76adf6ce22b3 in Status: IN_PROGRESS for 2s [ 1121.678804] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.679110] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.679253] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.679582] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.679776] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.679962] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Segment Port 366d7d30-f68e-430a-a4ea-f50371cc210d not found, creating... [ 1121.680259] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.680454] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.680633] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.680874] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.681057] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.681387] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.681615] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.681795] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.682089] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.682262] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.682434] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Resource: SegmentPort with ID: 366d7d30-f68e-430a-a4ea-f50371cc210d is going to be created. [ 1121.722061] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.722061] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.722061] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.722310] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.722453] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.722714] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "port-366d7d30-f68e-430a-a4ea-f50371cc210d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.957443] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2240419a-b1eb-469c-b2f2-8c54a91fa4b9: rpc.has_security_group_logging(os_id): False [ 1121.976924] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.977153] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.977153] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.977378] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.977467] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.977659] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.977758] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.977822] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.977961] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.978050] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.978401] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.978401] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.978401] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.978614] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.978614] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.978774] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.978860] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.978935] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.979069] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.979145] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.979231] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2240419a-b1eb-469c-b2f2-8c54a91fa4b9 is going to be created. [ 1121.994984] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9f2518e8-b195-4520-b262-caa765ab7e27',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1122.035561] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.035764] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.035805] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.036133] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.036311] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.046393] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2240419a-b1eb-469c-b2f2-8c54a91fa4b9 in Status: IN_PROGRESS for 2s [ 1122.495273] env[69188]: INFO networking_nsxv3.common.synchronization [req-6b92c673-0a99-48a1-9a84-0be00047a068 req-296754f9-9e77-49de-b7d7-defe62aca949 service nova] Enqueued Resource ID: 9482bec7-7d68-4fe1-8d77-d380c3f6dc7a with Priority: HIGHEST for action security_group_rules [ 1122.495464] env[69188]: INFO networking_nsxv3.common.synchronization [req-6b92c673-0a99-48a1-9a84-0be00047a068 req-296754f9-9e77-49de-b7d7-defe62aca949 service nova] Enqueued Resource ID: 9482bec7-7d68-4fe1-8d77-d380c3f6dc7a with Priority: HIGHEST for action security_group_members [ 1122.495618] env[69188]: INFO networking_nsxv3.common.synchronization [req-6b92c673-0a99-48a1-9a84-0be00047a068 req-296754f9-9e77-49de-b7d7-defe62aca949 service nova] Enqueued Resource ID: 366d7d30-f68e-430a-a4ea-f50371cc210d with Priority: HIGHEST for action port [ 1122.496156] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9482bec7-7d68-4fe1-8d77-d380c3f6dc7a with Priority: HIGHEST for action security_group_rules [ 1122.496293] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9482bec7-7d68-4fe1-8d77-d380c3f6dc7a with Priority: HIGHEST for action security_group_members [ 1122.496382] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 366d7d30-f68e-430a-a4ea-f50371cc210d with Priority: HIGHEST for action port [ 1122.496880] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9482bec7-7d68-4fe1-8d77-d380c3f6dc7a taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.497016] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9482bec7-7d68-4fe1-8d77-d380c3f6dc7a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.497396] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9482bec7-7d68-4fe1-8d77-d380c3f6dc7a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.497396] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9482bec7-7d68-4fe1-8d77-d380c3f6dc7a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.497396] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9482bec7-7d68-4fe1-8d77-d380c3f6dc7a',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1122.499400] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-9482bec7-7d68-4fe1-8d77-d380c3f6dc7a taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.499400] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9482bec7-7d68-4fe1-8d77-d380c3f6dc7a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.499400] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-366d7d30-f68e-430a-a4ea-f50371cc210d taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.499400] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-366d7d30-f68e-430a-a4ea-f50371cc210d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.499400] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-366d7d30-f68e-430a-a4ea-f50371cc210d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.499400] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-366d7d30-f68e-430a-a4ea-f50371cc210d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.499400] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('366d7d30-f68e-430a-a4ea-f50371cc210d',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1122.501218] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9f2518e8-b195-4520-b262-caa765ab7e27',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1122.969104] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9482bec7-7d68-4fe1-8d77-d380c3f6dc7a in Status: SUCCESS [ 1122.969452] env[69188]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9482bec7-7d68-4fe1-8d77-d380c3f6dc7a deletion is rescheduled due to dependency. [ 1122.969452] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9482bec7-7d68-4fe1-8d77-d380c3f6dc7a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.969625] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9482bec7-7d68-4fe1-8d77-d380c3f6dc7a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.969841] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9482bec7-7d68-4fe1-8d77-d380c3f6dc7a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.970054] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.970179] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.970248] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.970459] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.970568] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.970617] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9482bec7-7d68-4fe1-8d77-d380c3f6dc7a',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1123.000740] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-9482bec7-7d68-4fe1-8d77-d380c3f6dc7a taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.000905] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9482bec7-7d68-4fe1-8d77-d380c3f6dc7a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.001069] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 366d7d30-f68e-430a-a4ea-f50371cc210d with status ACTIVE [ 1123.002028] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.002028] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.002028] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.002028] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.002028] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.002028] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.002321] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.002321] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.002321] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.002554] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.002554] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.002716] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.002716] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.002838] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.002916] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.002983] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 366d7d30-f68e-430a-a4ea-f50371cc210d is going to be updated. [ 1123.004179] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.004290] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.004355] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.004510] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.004591] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.004708] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9f2518e8-b195-4520-b262-caa765ab7e27 is going to be updated. [ 1123.024106] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.024251] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.024323] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.024664] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.024814] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.024980] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-366d7d30-f68e-430a-a4ea-f50371cc210d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.031318] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.031318] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.031318] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.031635] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.031635] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.040661] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9f2518e8-b195-4520-b262-caa765ab7e27 in Status: IN_PROGRESS for 2s [ 1123.299803] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c7e4a274-48d0-4c86-9db6-5b72611db3e7 in Status: SUCCESS [ 1123.299803] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c7e4a274-48d0-4c86-9db6-5b72611db3e7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.299987] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c7e4a274-48d0-4c86-9db6-5b72611db3e7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.300227] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c7e4a274-48d0-4c86-9db6-5b72611db3e7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.300424] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.300559] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.300629] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.300787] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.300869] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.300957] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c7e4a274-48d0-4c86-9db6-5b72611db3e7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.301058] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c7e4a274-48d0-4c86-9db6-5b72611db3e7',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1123.473393] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9482bec7-7d68-4fe1-8d77-d380c3f6dc7a',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1123.538029] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 24a7b083-b432-46d6-94de-76adf6ce22b3 in Status: SUCCESS [ 1123.538170] env[69188]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 24a7b083-b432-46d6-94de-76adf6ce22b3 deletion is rescheduled due to dependency. [ 1123.538253] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-24a7b083-b432-46d6-94de-76adf6ce22b3" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.803919] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-c7e4a274-48d0-4c86-9db6-5b72611db3e7 taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.804179] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c7e4a274-48d0-4c86-9db6-5b72611db3e7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.804303] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c7e4a274-48d0-4c86-9db6-5b72611db3e7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.804595] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c7e4a274-48d0-4c86-9db6-5b72611db3e7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.804839] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.804996] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.805119] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.805337] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.805438] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.805529] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c7e4a274-48d0-4c86-9db6-5b72611db3e7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.805687] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-c7e4a274-48d0-4c86-9db6-5b72611db3e7 taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.805782] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c7e4a274-48d0-4c86-9db6-5b72611db3e7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.805849] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c7e4a274-48d0-4c86-9db6-5b72611db3e7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.805982] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c7e4a274-48d0-4c86-9db6-5b72611db3e7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.806147] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.806242] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.806594] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.806594] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.806594] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.806693] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c7e4a274-48d0-4c86-9db6-5b72611db3e7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.806720] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c7e4a274-48d0-4c86-9db6-5b72611db3e7',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1123.976079] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9482bec7-7d68-4fe1-8d77-d380c3f6dc7a',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1124.059048] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2240419a-b1eb-469c-b2f2-8c54a91fa4b9 in Status: SUCCESS [ 1124.059265] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2240419a-b1eb-469c-b2f2-8c54a91fa4b9" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.309135] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c7e4a274-48d0-4c86-9db6-5b72611db3e7: rpc.has_security_group_logging(os_id): False [ 1124.326347] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.326514] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.326647] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.326875] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.326968] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.327206] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.327302] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.327359] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.327512] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.327591] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.327829] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.327942] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.328009] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.328156] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.328233] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.328420] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.328513] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.328576] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.328710] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.328782] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.328864] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c7e4a274-48d0-4c86-9db6-5b72611db3e7 is going to be created. [ 1124.385034] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.385284] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.385357] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.385590] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.385770] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.396095] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c7e4a274-48d0-4c86-9db6-5b72611db3e7 in Status: IN_PROGRESS for 2s [ 1124.481092] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.481092] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.481092] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.481092] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.481092] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.481092] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9482bec7-7d68-4fe1-8d77-d380c3f6dc7a is going to be updated. [ 1124.507505] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.507505] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.507505] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.507805] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.507850] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.515899] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9482bec7-7d68-4fe1-8d77-d380c3f6dc7a in Status: IN_PROGRESS for 2s [ 1125.050172] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9f2518e8-b195-4520-b262-caa765ab7e27 in Status: SUCCESS [ 1125.050493] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9f2518e8-b195-4520-b262-caa765ab7e27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.406136] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c7e4a274-48d0-4c86-9db6-5b72611db3e7 in Status: SUCCESS [ 1126.406550] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c7e4a274-48d0-4c86-9db6-5b72611db3e7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.524439] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9482bec7-7d68-4fe1-8d77-d380c3f6dc7a in Status: SUCCESS [ 1126.524709] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9482bec7-7d68-4fe1-8d77-d380c3f6dc7a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.524905] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9482bec7-7d68-4fe1-8d77-d380c3f6dc7a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.525172] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9482bec7-7d68-4fe1-8d77-d380c3f6dc7a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.525370] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.525491] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.525538] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.525735] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.525836] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.525928] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9482bec7-7d68-4fe1-8d77-d380c3f6dc7a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.526067] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9482bec7-7d68-4fe1-8d77-d380c3f6dc7a',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1127.028449] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9482bec7-7d68-4fe1-8d77-d380c3f6dc7a',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1127.497442] env[69188]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1127.497788] env[69188]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1127.532130] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9482bec7-7d68-4fe1-8d77-d380c3f6dc7a: rpc.has_security_group_logging(os_id): False [ 1127.549147] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.549312] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.549384] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.549598] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.549718] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.549941] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.550052] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.550117] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.550275] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.550356] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.550443] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9482bec7-7d68-4fe1-8d77-d380c3f6dc7a is going to be updated. [ 1127.601049] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.601049] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.601049] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.601270] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.601391] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.612428] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9482bec7-7d68-4fe1-8d77-d380c3f6dc7a in Status: IN_PROGRESS for 2s [ 1127.944221] env[69188]: INFO networking_nsxv3.common.synchronization [req-ba0f9793-ddce-48a5-9881-e8f8303d17b4 req-10868df2-51e0-465a-9b33-1da6f7b0ee09 tempest-InstanceActionsNegativeTestJSON-1775938039 tempest-InstanceActionsNegativeTestJSON-1775938039-project-member] Enqueued Resource ID: 2240419a-b1eb-469c-b2f2-8c54a91fa4b9 with Priority: HIGHEST for action security_group_members [ 1127.944872] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2240419a-b1eb-469c-b2f2-8c54a91fa4b9 with Priority: HIGHEST for action security_group_members [ 1127.945363] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-2240419a-b1eb-469c-b2f2-8c54a91fa4b9 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.945363] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2240419a-b1eb-469c-b2f2-8c54a91fa4b9" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.945470] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2240419a-b1eb-469c-b2f2-8c54a91fa4b9" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.946298] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2240419a-b1eb-469c-b2f2-8c54a91fa4b9" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.946463] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.947261] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.947261] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.947261] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.947261] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.947261] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2240419a-b1eb-469c-b2f2-8c54a91fa4b9',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1128.450036] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.450236] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.450236] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.450522] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.450522] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.450712] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.450886] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.450886] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.451215] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.451215] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.451215] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2240419a-b1eb-469c-b2f2-8c54a91fa4b9 is going to be updated. [ 1128.488733] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.488733] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.488733] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.488733] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.488733] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.496673] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2240419a-b1eb-469c-b2f2-8c54a91fa4b9 in Status: IN_PROGRESS for 2s [ 1129.624300] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9482bec7-7d68-4fe1-8d77-d380c3f6dc7a in Status: SUCCESS [ 1129.624581] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9482bec7-7d68-4fe1-8d77-d380c3f6dc7a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.506548] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2240419a-b1eb-469c-b2f2-8c54a91fa4b9 in Status: SUCCESS [ 1130.506736] env[69188]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2240419a-b1eb-469c-b2f2-8c54a91fa4b9 deletion is rescheduled due to dependency. [ 1130.506941] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2240419a-b1eb-469c-b2f2-8c54a91fa4b9" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.945897] env[69188]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1132.946696] env[69188]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1134.407274] env[69188]: INFO networking_nsxv3.common.synchronization [req-e493e3c1-6f33-42c0-8b70-b5e025d8eb6d req-316bce49-9b22-4664-a2f3-524df892e0f4 tempest-ServersTestJSON-1495057482 tempest-ServersTestJSON-1495057482-project-member] Enqueued Resource ID: 9f2518e8-b195-4520-b262-caa765ab7e27 with Priority: HIGHEST for action security_group_members [ 1134.407783] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f2518e8-b195-4520-b262-caa765ab7e27 with Priority: HIGHEST for action security_group_members [ 1134.408091] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-9f2518e8-b195-4520-b262-caa765ab7e27 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.408216] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9f2518e8-b195-4520-b262-caa765ab7e27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.408283] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9f2518e8-b195-4520-b262-caa765ab7e27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.408480] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9f2518e8-b195-4520-b262-caa765ab7e27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.408663] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.408776] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.408838] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.408985] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.409081] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.409203] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9f2518e8-b195-4520-b262-caa765ab7e27',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1134.671775] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock network-507 taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.671985] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "network-507" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.672146] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "network-507" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.672429] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "network-507" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.672702] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.672867] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.673016] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.673241] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.673393] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.673610] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1134.673746] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] NeedRegenerationException {{(pid=69188) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1134.673864] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] no value, waiting for create lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1134.673990] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] value creation lock acquired {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1134.674097] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1134.674206] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Calling creation function for not-yet-present value {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1134.674344] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1134.699592] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1134.699801] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=69188) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1134.699884] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Released creation lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1134.700089] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "network-507" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.700405] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock port-9dcd8093-5913-4fab-8dba-728730cfd506 taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.700574] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "port-9dcd8093-5913-4fab-8dba-728730cfd506" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.700769] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "port-9dcd8093-5913-4fab-8dba-728730cfd506" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.701151] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "port-9dcd8093-5913-4fab-8dba-728730cfd506" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.701325] env[69188]: DEBUG networking_nsxv3.api.rpc [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9dcd8093-5913-4fab-8dba-728730cfd506',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1134.915103] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9f2518e8-b195-4520-b262-caa765ab7e27',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1135.203749] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.203991] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.204139] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.204438] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.204591] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.204752] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Segment Port 9dcd8093-5913-4fab-8dba-728730cfd506 not found, creating... [ 1135.205034] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.205201] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.205324] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.205542] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.205689] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.206190] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.206361] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.206484] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.206713] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.206854] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.206996] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Resource: SegmentPort with ID: 9dcd8093-5913-4fab-8dba-728730cfd506 is going to be created. [ 1135.226350] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.226543] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.226682] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.226937] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.227190] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.227425] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "port-9dcd8093-5913-4fab-8dba-728730cfd506" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.417348] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9f2518e8-b195-4520-b262-caa765ab7e27',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1135.919623] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.919741] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.919817] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.920058] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.920154] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.920249] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9f2518e8-b195-4520-b262-caa765ab7e27 is going to be updated. [ 1135.946586] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.946780] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.946780] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.946988] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.947146] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.956273] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9f2518e8-b195-4520-b262-caa765ab7e27 in Status: IN_PROGRESS for 2s [ 1136.410243] env[69188]: INFO networking_nsxv3.common.synchronization [req-e493e3c1-6f33-42c0-8b70-b5e025d8eb6d req-e41ae7e2-9f96-4355-8d7b-8888c2a5a427 service nova] Enqueued Resource ID: 9f2518e8-b195-4520-b262-caa765ab7e27 with Priority: HIGHEST for action security_group_rules [ 1136.410243] env[69188]: INFO networking_nsxv3.common.synchronization [req-e493e3c1-6f33-42c0-8b70-b5e025d8eb6d req-e41ae7e2-9f96-4355-8d7b-8888c2a5a427 service nova] Enqueued Resource ID: 9f2518e8-b195-4520-b262-caa765ab7e27 with Priority: HIGHEST for action security_group_members [ 1136.410243] env[69188]: INFO networking_nsxv3.common.synchronization [req-e493e3c1-6f33-42c0-8b70-b5e025d8eb6d req-e41ae7e2-9f96-4355-8d7b-8888c2a5a427 service nova] Enqueued Resource ID: 9dcd8093-5913-4fab-8dba-728730cfd506 with Priority: HIGHEST for action port [ 1136.410243] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f2518e8-b195-4520-b262-caa765ab7e27 with Priority: HIGHEST for action security_group_rules [ 1136.410243] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f2518e8-b195-4520-b262-caa765ab7e27 with Priority: HIGHEST for action security_group_members [ 1136.410243] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9dcd8093-5913-4fab-8dba-728730cfd506 with Priority: HIGHEST for action port [ 1136.413830] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9f2518e8-b195-4520-b262-caa765ab7e27 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.413830] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9f2518e8-b195-4520-b262-caa765ab7e27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.413830] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9f2518e8-b195-4520-b262-caa765ab7e27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.413830] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9f2518e8-b195-4520-b262-caa765ab7e27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.413830] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9f2518e8-b195-4520-b262-caa765ab7e27',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1136.414833] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-9f2518e8-b195-4520-b262-caa765ab7e27 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.414993] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9f2518e8-b195-4520-b262-caa765ab7e27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.415157] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-9dcd8093-5913-4fab-8dba-728730cfd506 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.415262] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9dcd8093-5913-4fab-8dba-728730cfd506" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.415305] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9dcd8093-5913-4fab-8dba-728730cfd506" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.415475] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9dcd8093-5913-4fab-8dba-728730cfd506" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.415543] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9dcd8093-5913-4fab-8dba-728730cfd506',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1136.918531] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-9f2518e8-b195-4520-b262-caa765ab7e27 taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.918920] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9f2518e8-b195-4520-b262-caa765ab7e27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.921105] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9dcd8093-5913-4fab-8dba-728730cfd506 with status ACTIVE [ 1136.921973] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.921973] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.921973] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.921973] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.921973] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.922526] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.922526] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.922526] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.922824] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.922824] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.923068] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.923199] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.923303] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.923477] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.923594] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.923799] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9dcd8093-5913-4fab-8dba-728730cfd506 is going to be updated. [ 1136.944561] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.944821] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.944912] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.945209] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.945426] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.945638] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9dcd8093-5913-4fab-8dba-728730cfd506" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.966043] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9f2518e8-b195-4520-b262-caa765ab7e27 in Status: SUCCESS [ 1137.966043] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9f2518e8-b195-4520-b262-caa765ab7e27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.966387] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9f2518e8-b195-4520-b262-caa765ab7e27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.966387] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9f2518e8-b195-4520-b262-caa765ab7e27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.966477] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.966587] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.966652] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.966795] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.966877] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.966967] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9f2518e8-b195-4520-b262-caa765ab7e27',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1138.469020] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9f2518e8-b195-4520-b262-caa765ab7e27',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1138.971253] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9f2518e8-b195-4520-b262-caa765ab7e27',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1139.473843] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.474050] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.474165] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.474435] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.474535] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.474960] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9f2518e8-b195-4520-b262-caa765ab7e27 is going to be updated. [ 1139.500159] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.500301] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.500371] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.500594] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.500766] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.508689] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9f2518e8-b195-4520-b262-caa765ab7e27 in Status: IN_PROGRESS for 2s [ 1140.071509] env[69188]: INFO networking_nsxv3.common.synchronization [req-0fc446b8-c130-42c6-9145-973558bad83a req-4249676f-b143-40ed-9385-b7848b92c6f6 tempest-DeleteServersTestJSON-857706435 tempest-DeleteServersTestJSON-857706435-project-member] Enqueued Resource ID: 397559b2-3c5a-424d-b09d-43a25d2abba6 with Priority: HIGHEST for action security_group_members [ 1140.071982] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 397559b2-3c5a-424d-b09d-43a25d2abba6 with Priority: HIGHEST for action security_group_members [ 1140.072309] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-397559b2-3c5a-424d-b09d-43a25d2abba6 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.072430] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-397559b2-3c5a-424d-b09d-43a25d2abba6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.072496] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-397559b2-3c5a-424d-b09d-43a25d2abba6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.072690] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-397559b2-3c5a-424d-b09d-43a25d2abba6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.072839] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.072934] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.072996] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.073304] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.073429] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.073550] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('397559b2-3c5a-424d-b09d-43a25d2abba6',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1140.083795] env[69188]: INFO networking_nsxv3.common.synchronization [req-816a06a5-9672-4437-b240-f43ee08748fc req-fe7676df-cddc-404c-afff-9f3dffcdd501 tempest-ServerAddressesNegativeTestJSON-111320539 tempest-ServerAddressesNegativeTestJSON-111320539-project-member] Enqueued Resource ID: c7e4a274-48d0-4c86-9db6-5b72611db3e7 with Priority: HIGHEST for action security_group_members [ 1140.084798] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c7e4a274-48d0-4c86-9db6-5b72611db3e7 with Priority: HIGHEST for action security_group_members [ 1140.085461] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-c7e4a274-48d0-4c86-9db6-5b72611db3e7 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.085632] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c7e4a274-48d0-4c86-9db6-5b72611db3e7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.085800] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c7e4a274-48d0-4c86-9db6-5b72611db3e7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.087145] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c7e4a274-48d0-4c86-9db6-5b72611db3e7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.087242] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.087422] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.087494] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.087773] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.087809] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.087992] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c7e4a274-48d0-4c86-9db6-5b72611db3e7',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1140.134946] env[69188]: INFO networking_nsxv3.common.synchronization [req-c03446e4-6678-4882-a056-f8168f36f8fa req-b9c2a38d-7dfd-4ddf-bf69-a4ba13196c71 tempest-ServerRescueNegativeTestJSON-1937748911 tempest-ServerRescueNegativeTestJSON-1937748911-project-member] Enqueued Resource ID: e3296f55-96ac-44eb-a498-8c6ab147c5ab with Priority: HIGHEST for action security_group_members [ 1140.135637] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e3296f55-96ac-44eb-a498-8c6ab147c5ab with Priority: HIGHEST for action security_group_members [ 1140.135936] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-e3296f55-96ac-44eb-a498-8c6ab147c5ab taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.136128] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e3296f55-96ac-44eb-a498-8c6ab147c5ab" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.136213] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e3296f55-96ac-44eb-a498-8c6ab147c5ab" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.136374] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e3296f55-96ac-44eb-a498-8c6ab147c5ab" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.140106] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.140106] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.140106] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.140106] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.140106] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.140106] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e3296f55-96ac-44eb-a498-8c6ab147c5ab',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1140.575514] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.575665] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.575769] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.576072] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.576179] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.576379] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.576481] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.576543] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.576695] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.576768] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.576855] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 397559b2-3c5a-424d-b09d-43a25d2abba6 is going to be updated. [ 1140.591588] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.591739] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.591779] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.591966] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.592064] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.592239] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.592334] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.592395] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.592537] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.592611] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.592711] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c7e4a274-48d0-4c86-9db6-5b72611db3e7 is going to be updated. [ 1140.604276] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.604395] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.604456] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.604617] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.604745] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.610860] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 397559b2-3c5a-424d-b09d-43a25d2abba6 in Status: IN_PROGRESS for 2s [ 1140.616560] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.616671] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.616734] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.616896] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.617063] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.624166] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c7e4a274-48d0-4c86-9db6-5b72611db3e7 in Status: IN_PROGRESS for 2s [ 1140.639595] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.639721] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.639790] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.640010] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.640109] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.640296] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.640395] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.640458] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.640605] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.640681] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.640814] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e3296f55-96ac-44eb-a498-8c6ab147c5ab is going to be updated. [ 1140.666026] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.666199] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.666243] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.666423] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.666556] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.675757] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e3296f55-96ac-44eb-a498-8c6ab147c5ab in Status: IN_PROGRESS for 2s [ 1141.517883] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9f2518e8-b195-4520-b262-caa765ab7e27 in Status: SUCCESS [ 1141.518251] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9f2518e8-b195-4520-b262-caa765ab7e27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.518251] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9f2518e8-b195-4520-b262-caa765ab7e27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.518409] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9f2518e8-b195-4520-b262-caa765ab7e27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.518604] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.518799] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.518886] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.519064] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.519152] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.519235] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9f2518e8-b195-4520-b262-caa765ab7e27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.519327] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9f2518e8-b195-4520-b262-caa765ab7e27',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1142.022092] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-9f2518e8-b195-4520-b262-caa765ab7e27 taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.022272] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9f2518e8-b195-4520-b262-caa765ab7e27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.022328] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9f2518e8-b195-4520-b262-caa765ab7e27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.022539] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9f2518e8-b195-4520-b262-caa765ab7e27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.022710] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.022834] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.022875] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.023019] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.023118] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.023195] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9f2518e8-b195-4520-b262-caa765ab7e27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.023337] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-9f2518e8-b195-4520-b262-caa765ab7e27 taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.023443] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9f2518e8-b195-4520-b262-caa765ab7e27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.023487] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9f2518e8-b195-4520-b262-caa765ab7e27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.023628] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9f2518e8-b195-4520-b262-caa765ab7e27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.023780] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.023875] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.023934] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.024089] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.024164] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.024261] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9f2518e8-b195-4520-b262-caa765ab7e27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.024352] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9f2518e8-b195-4520-b262-caa765ab7e27',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1142.526190] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9f2518e8-b195-4520-b262-caa765ab7e27: rpc.has_security_group_logging(os_id): False [ 1142.542696] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.542874] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.542914] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.543336] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.543435] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.543634] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.543759] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.543829] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.543993] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.544090] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.544278] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.544372] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.544469] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.544602] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.544648] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.544831] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.544955] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.545013] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.545124] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.545232] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.545344] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9f2518e8-b195-4520-b262-caa765ab7e27 is going to be updated. [ 1142.603777] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.603975] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.604106] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.604355] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.604546] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.620040] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 397559b2-3c5a-424d-b09d-43a25d2abba6 in Status: SUCCESS [ 1142.620040] env[69188]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 397559b2-3c5a-424d-b09d-43a25d2abba6 deletion is rescheduled due to dependency. [ 1142.620040] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-397559b2-3c5a-424d-b09d-43a25d2abba6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.620547] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9f2518e8-b195-4520-b262-caa765ab7e27 in Status: IN_PROGRESS for 2s [ 1142.630786] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c7e4a274-48d0-4c86-9db6-5b72611db3e7 in Status: SUCCESS [ 1142.630786] env[69188]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c7e4a274-48d0-4c86-9db6-5b72611db3e7 deletion is rescheduled due to dependency. [ 1142.630786] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c7e4a274-48d0-4c86-9db6-5b72611db3e7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.692106] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e3296f55-96ac-44eb-a498-8c6ab147c5ab in Status: SUCCESS [ 1142.692106] env[69188]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e3296f55-96ac-44eb-a498-8c6ab147c5ab deletion is rescheduled due to dependency. [ 1142.692106] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e3296f55-96ac-44eb-a498-8c6ab147c5ab" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.635127] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9f2518e8-b195-4520-b262-caa765ab7e27 in Status: SUCCESS [ 1144.635589] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9f2518e8-b195-4520-b262-caa765ab7e27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.954801] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock network-22 taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.954981] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "network-22" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.955140] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "network-22" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.955426] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "network-22" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.955699] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.955864] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.955986] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.956213] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.956359] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.956568] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1144.956682] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] NeedRegenerationException {{(pid=69188) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1144.956792] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] no value, waiting for create lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1144.956920] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] value creation lock acquired {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1144.957111] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1144.957238] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Calling creation function for not-yet-present value {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1144.957377] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1144.976361] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1144.976521] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69188) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1144.976662] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Released creation lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1144.976829] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "network-22" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.977126] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock port-995ce199-c506-47a3-8d98-a86b919ece91 taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.977307] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "port-995ce199-c506-47a3-8d98-a86b919ece91" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.977444] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "port-995ce199-c506-47a3-8d98-a86b919ece91" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.977678] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "port-995ce199-c506-47a3-8d98-a86b919ece91" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.977820] env[69188]: DEBUG networking_nsxv3.api.rpc [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('995ce199-c506-47a3-8d98-a86b919ece91',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1145.136597] env[69188]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1145.136745] env[69188]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1145.480493] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.480717] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.480887] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.481212] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.481371] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.481662] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.481835] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.481973] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.482211] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.482355] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.482637] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.482797] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.482918] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.483204] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.483289] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.483431] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Resource: SegmentPort with ID: 995ce199-c506-47a3-8d98-a86b919ece91 is going to be updated. [ 1145.503223] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.503223] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.503375] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.504031] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.504031] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.504163] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "port-995ce199-c506-47a3-8d98-a86b919ece91" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.199734] env[69188]: INFO networking_nsxv3.common.synchronization [req-ae315e27-f512-4d1c-bac4-4fd3878e256f req-f32a4198-6c15-4b43-8a52-4c82d6905068 service nova] Enqueued Resource ID: 938f39e5-b2c4-4a5d-b8ea-03c277953ec9 with Priority: HIGHEST for action security_group_rules [ 1146.199987] env[69188]: INFO networking_nsxv3.common.synchronization [req-ae315e27-f512-4d1c-bac4-4fd3878e256f req-f32a4198-6c15-4b43-8a52-4c82d6905068 service nova] Enqueued Resource ID: 938f39e5-b2c4-4a5d-b8ea-03c277953ec9 with Priority: HIGHEST for action security_group_members [ 1146.200061] env[69188]: INFO networking_nsxv3.common.synchronization [req-ae315e27-f512-4d1c-bac4-4fd3878e256f req-f32a4198-6c15-4b43-8a52-4c82d6905068 service nova] Enqueued Resource ID: 995ce199-c506-47a3-8d98-a86b919ece91 with Priority: HIGHEST for action port [ 1146.200547] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 938f39e5-b2c4-4a5d-b8ea-03c277953ec9 with Priority: HIGHEST for action security_group_rules [ 1146.200684] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 938f39e5-b2c4-4a5d-b8ea-03c277953ec9 with Priority: HIGHEST for action security_group_members [ 1146.200791] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 995ce199-c506-47a3-8d98-a86b919ece91 with Priority: HIGHEST for action port [ 1146.201229] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-938f39e5-b2c4-4a5d-b8ea-03c277953ec9 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.201367] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-938f39e5-b2c4-4a5d-b8ea-03c277953ec9" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.201437] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-938f39e5-b2c4-4a5d-b8ea-03c277953ec9" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.201638] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-938f39e5-b2c4-4a5d-b8ea-03c277953ec9" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.201721] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('938f39e5-b2c4-4a5d-b8ea-03c277953ec9',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1146.202952] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-938f39e5-b2c4-4a5d-b8ea-03c277953ec9 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.203090] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-938f39e5-b2c4-4a5d-b8ea-03c277953ec9" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.203192] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-938f39e5-b2c4-4a5d-b8ea-03c277953ec9" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.203369] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-938f39e5-b2c4-4a5d-b8ea-03c277953ec9" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.203519] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.203623] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.203692] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.203834] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.203971] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.204037] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('938f39e5-b2c4-4a5d-b8ea-03c277953ec9',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1146.204742] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-995ce199-c506-47a3-8d98-a86b919ece91 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.204848] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-995ce199-c506-47a3-8d98-a86b919ece91" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.204914] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-995ce199-c506-47a3-8d98-a86b919ece91" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.205127] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-995ce199-c506-47a3-8d98-a86b919ece91" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.205156] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('995ce199-c506-47a3-8d98-a86b919ece91',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1146.707729] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-938f39e5-b2c4-4a5d-b8ea-03c277953ec9 taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.707729] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-938f39e5-b2c4-4a5d-b8ea-03c277953ec9" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.707729] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('938f39e5-b2c4-4a5d-b8ea-03c277953ec9',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1146.708597] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 995ce199-c506-47a3-8d98-a86b919ece91 with status ACTIVE [ 1146.708827] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.708965] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.709063] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.709310] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.709395] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.709601] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.709720] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.709797] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.709969] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.710058] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.710270] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.710388] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.711023] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.711023] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.711023] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.711023] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 995ce199-c506-47a3-8d98-a86b919ece91 is going to be updated. [ 1146.730794] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.730983] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.731043] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.731275] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.731417] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.731575] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-995ce199-c506-47a3-8d98-a86b919ece91" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.213221] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('938f39e5-b2c4-4a5d-b8ea-03c277953ec9',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.716569] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.716805] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.716924] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.717214] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.720797] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.720938] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 938f39e5-b2c4-4a5d-b8ea-03c277953ec9 is going to be updated. [ 1147.725841] env[69188]: INFO networking_nsxv3.common.synchronization [req-c850f5e6-2ce8-422d-8f57-cae7cfbdd368 req-7278413b-6684-4af5-81a4-d7e5f6ba8549 tempest-AttachInterfacesTestJSON-1255877948 tempest-AttachInterfacesTestJSON-1255877948-project-member] Enqueued Resource ID: 12570d95-0a4a-4579-82c8-53ecf65f714e with Priority: HIGHEST for action security_group_members [ 1147.727295] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 12570d95-0a4a-4579-82c8-53ecf65f714e with Priority: HIGHEST for action security_group_members [ 1147.727709] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-12570d95-0a4a-4579-82c8-53ecf65f714e taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.727944] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-12570d95-0a4a-4579-82c8-53ecf65f714e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.728072] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-12570d95-0a4a-4579-82c8-53ecf65f714e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.728290] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-12570d95-0a4a-4579-82c8-53ecf65f714e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.728481] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.728588] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.728704] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.728952] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.729057] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.729152] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('12570d95-0a4a-4579-82c8-53ecf65f714e',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.789552] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.789703] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.789762] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.789979] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.790148] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.803498] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 938f39e5-b2c4-4a5d-b8ea-03c277953ec9 in Status: IN_PROGRESS for 2s [ 1148.192072] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock network-51 taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.192278] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "network-51" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.192410] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "network-51" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.192687] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "network-51" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.192950] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.193128] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.193341] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.193567] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.193718] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.193921] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1148.194050] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] NeedRegenerationException {{(pid=69188) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1148.194165] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] no value, waiting for create lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1148.194277] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] value creation lock acquired {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1148.194390] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1148.194497] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Calling creation function for not-yet-present value {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1148.194634] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1148.211860] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1148.212053] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=69188) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1148.212209] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Released creation lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1148.212385] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "network-51" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.212686] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock port-261df0b8-cc63-4bf8-bc1b-06e0c969b535 taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.212852] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "port-261df0b8-cc63-4bf8-bc1b-06e0c969b535" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.213275] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "port-261df0b8-cc63-4bf8-bc1b-06e0c969b535" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.213643] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "port-261df0b8-cc63-4bf8-bc1b-06e0c969b535" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.213643] env[69188]: DEBUG networking_nsxv3.api.rpc [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('261df0b8-cc63-4bf8-bc1b-06e0c969b535',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1148.231682] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.231817] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.231931] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.232321] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.232321] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.232478] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.232580] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.232642] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.232795] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.232935] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.232975] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 12570d95-0a4a-4579-82c8-53ecf65f714e is going to be deleted. [ 1148.258289] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.258452] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.258512] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.258694] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.258863] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.258919] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-12570d95-0a4a-4579-82c8-53ecf65f714e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.715555] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.715790] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.715931] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.716243] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.716396] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.716555] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Segment Port 261df0b8-cc63-4bf8-bc1b-06e0c969b535 not found, creating... [ 1148.716819] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.717142] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.717309] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.717544] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.717685] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.718831] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.718965] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.720580] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.720580] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.720580] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.720580] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Resource: SegmentPort with ID: 261df0b8-cc63-4bf8-bc1b-06e0c969b535 is going to be created. [ 1148.775903] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.776191] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.776360] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.776669] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.776937] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.777225] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "port-261df0b8-cc63-4bf8-bc1b-06e0c969b535" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.507266] env[69188]: INFO networking_nsxv3.common.synchronization [req-c850f5e6-2ce8-422d-8f57-cae7cfbdd368 req-0979fb19-c948-4d90-8720-fdb356521e2f service nova] Enqueued Resource ID: 12570d95-0a4a-4579-82c8-53ecf65f714e with Priority: HIGHEST for action security_group_rules [ 1149.507549] env[69188]: INFO networking_nsxv3.common.synchronization [req-c850f5e6-2ce8-422d-8f57-cae7cfbdd368 req-0979fb19-c948-4d90-8720-fdb356521e2f service nova] Enqueued Resource ID: 12570d95-0a4a-4579-82c8-53ecf65f714e with Priority: HIGHEST for action security_group_members [ 1149.507600] env[69188]: INFO networking_nsxv3.common.synchronization [req-c850f5e6-2ce8-422d-8f57-cae7cfbdd368 req-0979fb19-c948-4d90-8720-fdb356521e2f service nova] Enqueued Resource ID: 261df0b8-cc63-4bf8-bc1b-06e0c969b535 with Priority: HIGHEST for action port [ 1149.507818] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 12570d95-0a4a-4579-82c8-53ecf65f714e with Priority: HIGHEST for action security_group_rules [ 1149.507975] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 12570d95-0a4a-4579-82c8-53ecf65f714e with Priority: HIGHEST for action security_group_members [ 1149.508048] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 261df0b8-cc63-4bf8-bc1b-06e0c969b535 with Priority: HIGHEST for action port [ 1149.508598] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-12570d95-0a4a-4579-82c8-53ecf65f714e taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.508748] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-12570d95-0a4a-4579-82c8-53ecf65f714e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.508798] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-12570d95-0a4a-4579-82c8-53ecf65f714e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.508986] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-12570d95-0a4a-4579-82c8-53ecf65f714e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.509398] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('12570d95-0a4a-4579-82c8-53ecf65f714e',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1149.510220] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-12570d95-0a4a-4579-82c8-53ecf65f714e taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.510337] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-12570d95-0a4a-4579-82c8-53ecf65f714e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.510404] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-12570d95-0a4a-4579-82c8-53ecf65f714e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.510632] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-12570d95-0a4a-4579-82c8-53ecf65f714e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.510734] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.510814] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.510969] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.511021] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.511395] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.511395] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('12570d95-0a4a-4579-82c8-53ecf65f714e',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1149.515624] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-261df0b8-cc63-4bf8-bc1b-06e0c969b535 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.515746] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-261df0b8-cc63-4bf8-bc1b-06e0c969b535" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.515805] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-261df0b8-cc63-4bf8-bc1b-06e0c969b535" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.519437] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-261df0b8-cc63-4bf8-bc1b-06e0c969b535" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.519437] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('261df0b8-cc63-4bf8-bc1b-06e0c969b535',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1149.811505] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 938f39e5-b2c4-4a5d-b8ea-03c277953ec9 in Status: SUCCESS [ 1149.813998] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-938f39e5-b2c4-4a5d-b8ea-03c277953ec9" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.813998] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-938f39e5-b2c4-4a5d-b8ea-03c277953ec9" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.813998] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-938f39e5-b2c4-4a5d-b8ea-03c277953ec9" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.813998] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.813998] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.813998] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.813998] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.813998] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.813998] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-938f39e5-b2c4-4a5d-b8ea-03c277953ec9" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.813998] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('938f39e5-b2c4-4a5d-b8ea-03c277953ec9',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1150.018041] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('12570d95-0a4a-4579-82c8-53ecf65f714e',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1150.022111] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-12570d95-0a4a-4579-82c8-53ecf65f714e taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.022111] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-12570d95-0a4a-4579-82c8-53ecf65f714e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.022111] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 261df0b8-cc63-4bf8-bc1b-06e0c969b535 with status ACTIVE [ 1150.022111] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.022551] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.024068] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.024068] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.024068] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.024068] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.024068] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.024068] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.024068] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.027104] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.027104] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.027104] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.027104] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.027104] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.027104] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.027104] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 261df0b8-cc63-4bf8-bc1b-06e0c969b535 is going to be updated. [ 1150.045501] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.047037] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.047037] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.047037] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.047037] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.047037] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-261df0b8-cc63-4bf8-bc1b-06e0c969b535" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.259905] env[69188]: INFO networking_nsxv3.common.synchronization [req-b933160b-349b-49d8-b554-e3a4925154f9 req-9b41b93e-05eb-4cfc-86c5-6342c1e7b90a tempest-ServersTestJSON-1495057482 tempest-ServersTestJSON-1495057482-project-member] Enqueued Resource ID: 9f2518e8-b195-4520-b262-caa765ab7e27 with Priority: HIGHEST for action security_group_members [ 1150.263039] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f2518e8-b195-4520-b262-caa765ab7e27 with Priority: HIGHEST for action security_group_members [ 1150.263039] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-9f2518e8-b195-4520-b262-caa765ab7e27 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.263039] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9f2518e8-b195-4520-b262-caa765ab7e27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.263039] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9f2518e8-b195-4520-b262-caa765ab7e27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.263039] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9f2518e8-b195-4520-b262-caa765ab7e27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.263343] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.263343] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.263412] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.263530] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.263629] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.263726] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9f2518e8-b195-4520-b262-caa765ab7e27',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1150.316594] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-938f39e5-b2c4-4a5d-b8ea-03c277953ec9 taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.316966] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-938f39e5-b2c4-4a5d-b8ea-03c277953ec9" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.317159] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-938f39e5-b2c4-4a5d-b8ea-03c277953ec9" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.317356] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-938f39e5-b2c4-4a5d-b8ea-03c277953ec9" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.317730] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.317730] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.317730] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.317880] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.317880] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.317954] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-938f39e5-b2c4-4a5d-b8ea-03c277953ec9" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.318111] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-938f39e5-b2c4-4a5d-b8ea-03c277953ec9 taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.318199] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-938f39e5-b2c4-4a5d-b8ea-03c277953ec9" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.318298] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-938f39e5-b2c4-4a5d-b8ea-03c277953ec9" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.318484] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-938f39e5-b2c4-4a5d-b8ea-03c277953ec9" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.318628] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.318720] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.318784] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.318916] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.319092] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.319092] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-938f39e5-b2c4-4a5d-b8ea-03c277953ec9" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.319186] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('938f39e5-b2c4-4a5d-b8ea-03c277953ec9',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1150.522666] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('12570d95-0a4a-4579-82c8-53ecf65f714e',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1150.767208] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9f2518e8-b195-4520-b262-caa765ab7e27',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1150.823104] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 938f39e5-b2c4-4a5d-b8ea-03c277953ec9: rpc.has_security_group_logging(os_id): False [ 1150.838432] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.838639] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.838683] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.839082] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.839151] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.839386] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.839473] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.839505] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.839710] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.840390] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.840667] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.841145] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.841251] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.841495] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.841591] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.841852] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.842214] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.842362] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.842525] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.842656] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.842712] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 938f39e5-b2c4-4a5d-b8ea-03c277953ec9 is going to be updated. [ 1150.896335] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.896541] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.896655] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.896901] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.897092] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.911205] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 938f39e5-b2c4-4a5d-b8ea-03c277953ec9 in Status: IN_PROGRESS for 2s [ 1151.025272] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.025622] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.025622] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.025875] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.026022] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.026156] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 12570d95-0a4a-4579-82c8-53ecf65f714e is going to be created. [ 1151.049565] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.049749] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.049781] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.050055] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.050185] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.059121] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 12570d95-0a4a-4579-82c8-53ecf65f714e in Status: UNINITIALIZED for 2s [ 1151.269179] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9f2518e8-b195-4520-b262-caa765ab7e27',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1151.772688] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.773100] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.773100] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.773417] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.773417] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.773417] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9f2518e8-b195-4520-b262-caa765ab7e27 is going to be updated. [ 1151.802879] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.803042] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.803118] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.803351] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.803550] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.813756] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9f2518e8-b195-4520-b262-caa765ab7e27 in Status: IN_PROGRESS for 2s [ 1152.927731] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 938f39e5-b2c4-4a5d-b8ea-03c277953ec9 in Status: SUCCESS [ 1152.928099] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-938f39e5-b2c4-4a5d-b8ea-03c277953ec9" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.069741] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 12570d95-0a4a-4579-82c8-53ecf65f714e in Status: SUCCESS [ 1153.070319] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-12570d95-0a4a-4579-82c8-53ecf65f714e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.070587] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-12570d95-0a4a-4579-82c8-53ecf65f714e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.070837] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-12570d95-0a4a-4579-82c8-53ecf65f714e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.071185] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.071351] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.071425] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.071589] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.071677] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.071766] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-12570d95-0a4a-4579-82c8-53ecf65f714e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.071972] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('12570d95-0a4a-4579-82c8-53ecf65f714e',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1153.573887] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-12570d95-0a4a-4579-82c8-53ecf65f714e taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.574081] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-12570d95-0a4a-4579-82c8-53ecf65f714e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.574156] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-12570d95-0a4a-4579-82c8-53ecf65f714e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.574379] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-12570d95-0a4a-4579-82c8-53ecf65f714e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.574549] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.574652] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.574718] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.574931] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.575035] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.575129] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-12570d95-0a4a-4579-82c8-53ecf65f714e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.575283] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-12570d95-0a4a-4579-82c8-53ecf65f714e taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.575368] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-12570d95-0a4a-4579-82c8-53ecf65f714e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.575437] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-12570d95-0a4a-4579-82c8-53ecf65f714e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.575569] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-12570d95-0a4a-4579-82c8-53ecf65f714e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.575706] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.575792] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.575846] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.576061] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.576140] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.576219] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-12570d95-0a4a-4579-82c8-53ecf65f714e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.576309] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('12570d95-0a4a-4579-82c8-53ecf65f714e',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1153.826865] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9f2518e8-b195-4520-b262-caa765ab7e27 in Status: SUCCESS [ 1153.827114] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9f2518e8-b195-4520-b262-caa765ab7e27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.078199] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 12570d95-0a4a-4579-82c8-53ecf65f714e: rpc.has_security_group_logging(os_id): False [ 1154.094805] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.094962] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.095016] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.095277] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.095341] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.095585] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.095649] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.095683] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.095832] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.095909] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.096102] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.096197] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.096258] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.096398] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.096473] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.096653] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.096743] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.096804] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.096945] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.097050] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.097107] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 12570d95-0a4a-4579-82c8-53ecf65f714e is going to be created. [ 1154.119982] env[69188]: INFO networking_nsxv3.common.synchronization [None req-228687c7-a414-487b-81bf-d9f552adf71d tempest-AttachInterfacesTestJSON-1255877948 tempest-AttachInterfacesTestJSON-1255877948-project-member] Enqueued Resource ID: 12570d95-0a4a-4579-82c8-53ecf65f714e with Priority: HIGHEST for action security_group_members [ 1154.120299] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 12570d95-0a4a-4579-82c8-53ecf65f714e with Priority: HIGHEST for action security_group_members [ 1154.120600] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-12570d95-0a4a-4579-82c8-53ecf65f714e taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.120720] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-12570d95-0a4a-4579-82c8-53ecf65f714e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.120790] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-12570d95-0a4a-4579-82c8-53ecf65f714e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.121193] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-12570d95-0a4a-4579-82c8-53ecf65f714e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.121340] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.121448] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.121512] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.121674] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.121760] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.121852] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('12570d95-0a4a-4579-82c8-53ecf65f714e',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1154.149258] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.149433] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.149485] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.149709] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.151072] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.161059] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 12570d95-0a4a-4579-82c8-53ecf65f714e in Status: IN_PROGRESS for 2s [ 1154.624719] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('12570d95-0a4a-4579-82c8-53ecf65f714e',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1155.128391] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('12570d95-0a4a-4579-82c8-53ecf65f714e',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1155.629928] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.630224] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.630392] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.630598] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.630701] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.630832] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 12570d95-0a4a-4579-82c8-53ecf65f714e is going to be updated. [ 1155.660060] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.660212] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.660326] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.660496] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.660664] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.670383] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 12570d95-0a4a-4579-82c8-53ecf65f714e in Status: IN_PROGRESS for 2s [ 1155.932959] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock network-796 taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.933280] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "network-796" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.933426] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "network-796" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.933707] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "network-796" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.933984] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.934161] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.934284] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.934504] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.934655] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.934877] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1155.934997] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] NeedRegenerationException {{(pid=69188) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1155.935121] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] no value, waiting for create lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1155.935232] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] value creation lock acquired {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1155.935344] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1155.935452] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Calling creation function for not-yet-present value {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1155.935591] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1155.956270] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1155.956451] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69188) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1155.956598] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Released creation lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1155.956778] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "network-796" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.957111] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock port-a8f58709-40a0-44a2-9fc9-0e6c1122580b taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.957298] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "port-a8f58709-40a0-44a2-9fc9-0e6c1122580b" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.957424] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "port-a8f58709-40a0-44a2-9fc9-0e6c1122580b" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.957700] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "port-a8f58709-40a0-44a2-9fc9-0e6c1122580b" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.957846] env[69188]: DEBUG networking_nsxv3.api.rpc [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a8f58709-40a0-44a2-9fc9-0e6c1122580b',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1156.174464] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 12570d95-0a4a-4579-82c8-53ecf65f714e in Status: SUCCESS [ 1156.175229] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-12570d95-0a4a-4579-82c8-53ecf65f714e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.205181] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock network-51 taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.205343] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "network-51" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.205494] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "network-51" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.205808] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "network-51" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.206179] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.206405] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.206536] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.206766] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.206915] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.207338] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1156.207497] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] NeedRegenerationException {{(pid=69188) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1156.207624] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] no value, waiting for create lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1156.207741] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] value creation lock acquired {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1156.208017] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1156.208214] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Calling creation function for not-yet-present value {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1156.208419] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1156.224790] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1156.225126] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=69188) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1156.225353] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Released creation lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1156.225574] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "network-51" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.225903] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock port-b69f57d7-b3b6-43d8-854c-08d68248dd75 taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.226112] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "port-b69f57d7-b3b6-43d8-854c-08d68248dd75" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.226243] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "port-b69f57d7-b3b6-43d8-854c-08d68248dd75" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.226647] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "port-b69f57d7-b3b6-43d8-854c-08d68248dd75" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.226828] env[69188]: DEBUG networking_nsxv3.api.rpc [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b69f57d7-b3b6-43d8-854c-08d68248dd75',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1156.460642] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.460642] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.460907] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.461144] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.461359] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.462033] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.462177] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.462222] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.462497] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.462674] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.463061] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.463242] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.463392] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.463739] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.463938] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.464173] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Resource: SegmentPort with ID: a8f58709-40a0-44a2-9fc9-0e6c1122580b is going to be updated. [ 1156.484860] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.485105] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.485231] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.485520] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.485728] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.485989] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "port-a8f58709-40a0-44a2-9fc9-0e6c1122580b" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.732292] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.732532] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.732665] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.732973] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.733156] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.733349] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Segment Port b69f57d7-b3b6-43d8-854c-08d68248dd75 not found, creating... [ 1156.733652] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.733821] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.733945] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.734196] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.734342] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.734635] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.734794] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.734914] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.735150] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.735294] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.735439] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Resource: SegmentPort with ID: b69f57d7-b3b6-43d8-854c-08d68248dd75 is going to be created. [ 1156.754253] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.754483] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.754642] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.754938] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.755234] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.755542] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "port-b69f57d7-b3b6-43d8-854c-08d68248dd75" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.184847] env[69188]: INFO networking_nsxv3.common.synchronization [req-db7a1309-3046-4293-9fb6-9b47e530b530 req-a6ef94ac-1c25-4a80-b605-d16bfd80550b service nova] Enqueued Resource ID: 4c598260-71fe-43f5-ab89-63a95724ea23 with Priority: HIGHEST for action security_group_rules [ 1157.185225] env[69188]: INFO networking_nsxv3.common.synchronization [req-db7a1309-3046-4293-9fb6-9b47e530b530 req-a6ef94ac-1c25-4a80-b605-d16bfd80550b service nova] Enqueued Resource ID: 4c598260-71fe-43f5-ab89-63a95724ea23 with Priority: HIGHEST for action security_group_members [ 1157.185225] env[69188]: INFO networking_nsxv3.common.synchronization [req-db7a1309-3046-4293-9fb6-9b47e530b530 req-a6ef94ac-1c25-4a80-b605-d16bfd80550b service nova] Enqueued Resource ID: a8f58709-40a0-44a2-9fc9-0e6c1122580b with Priority: HIGHEST for action port [ 1157.185436] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4c598260-71fe-43f5-ab89-63a95724ea23 with Priority: HIGHEST for action security_group_rules [ 1157.185564] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4c598260-71fe-43f5-ab89-63a95724ea23 with Priority: HIGHEST for action security_group_members [ 1157.185661] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a8f58709-40a0-44a2-9fc9-0e6c1122580b with Priority: HIGHEST for action port [ 1157.186999] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4c598260-71fe-43f5-ab89-63a95724ea23 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.187212] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4c598260-71fe-43f5-ab89-63a95724ea23" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.187305] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4c598260-71fe-43f5-ab89-63a95724ea23" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.187554] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4c598260-71fe-43f5-ab89-63a95724ea23" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.187661] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4c598260-71fe-43f5-ab89-63a95724ea23',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1157.189110] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-4c598260-71fe-43f5-ab89-63a95724ea23 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.189386] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4c598260-71fe-43f5-ab89-63a95724ea23" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.189493] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4c598260-71fe-43f5-ab89-63a95724ea23" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.189744] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4c598260-71fe-43f5-ab89-63a95724ea23" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.189935] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.190076] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.190161] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.190772] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.190834] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.190999] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4c598260-71fe-43f5-ab89-63a95724ea23',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1157.192288] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-a8f58709-40a0-44a2-9fc9-0e6c1122580b taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.192519] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a8f58709-40a0-44a2-9fc9-0e6c1122580b" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.192599] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a8f58709-40a0-44a2-9fc9-0e6c1122580b" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.192766] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a8f58709-40a0-44a2-9fc9-0e6c1122580b" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.192843] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a8f58709-40a0-44a2-9fc9-0e6c1122580b',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1157.478956] env[69188]: INFO networking_nsxv3.common.synchronization [req-959901b3-71e7-419e-b053-0cc30bdf2a3d req-ea22ec90-6d7e-4b27-a240-3baedf15fcdd service nova] Enqueued Resource ID: 12570d95-0a4a-4579-82c8-53ecf65f714e with Priority: HIGHEST for action security_group_rules [ 1157.479157] env[69188]: INFO networking_nsxv3.common.synchronization [req-959901b3-71e7-419e-b053-0cc30bdf2a3d req-ea22ec90-6d7e-4b27-a240-3baedf15fcdd service nova] Enqueued Resource ID: 12570d95-0a4a-4579-82c8-53ecf65f714e with Priority: HIGHEST for action security_group_members [ 1157.479306] env[69188]: INFO networking_nsxv3.common.synchronization [req-959901b3-71e7-419e-b053-0cc30bdf2a3d req-ea22ec90-6d7e-4b27-a240-3baedf15fcdd service nova] Enqueued Resource ID: b69f57d7-b3b6-43d8-854c-08d68248dd75 with Priority: HIGHEST for action port [ 1157.479865] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 12570d95-0a4a-4579-82c8-53ecf65f714e with Priority: HIGHEST for action security_group_rules [ 1157.480010] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 12570d95-0a4a-4579-82c8-53ecf65f714e with Priority: HIGHEST for action security_group_members [ 1157.480118] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b69f57d7-b3b6-43d8-854c-08d68248dd75 with Priority: HIGHEST for action port [ 1157.480391] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-12570d95-0a4a-4579-82c8-53ecf65f714e taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.480627] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-12570d95-0a4a-4579-82c8-53ecf65f714e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.480725] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-12570d95-0a4a-4579-82c8-53ecf65f714e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.480915] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-12570d95-0a4a-4579-82c8-53ecf65f714e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.481035] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('12570d95-0a4a-4579-82c8-53ecf65f714e',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1157.481888] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-12570d95-0a4a-4579-82c8-53ecf65f714e taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.482532] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-12570d95-0a4a-4579-82c8-53ecf65f714e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.482532] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-b69f57d7-b3b6-43d8-854c-08d68248dd75 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.482532] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b69f57d7-b3b6-43d8-854c-08d68248dd75" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.482532] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b69f57d7-b3b6-43d8-854c-08d68248dd75" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.482532] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b69f57d7-b3b6-43d8-854c-08d68248dd75" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.482782] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b69f57d7-b3b6-43d8-854c-08d68248dd75',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1157.680662] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 12570d95-0a4a-4579-82c8-53ecf65f714e in Status: SUCCESS [ 1157.680892] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-12570d95-0a4a-4579-82c8-53ecf65f714e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.681124] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-12570d95-0a4a-4579-82c8-53ecf65f714e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.681354] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-12570d95-0a4a-4579-82c8-53ecf65f714e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.681544] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.681686] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.681753] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.681920] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.682037] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.682153] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('12570d95-0a4a-4579-82c8-53ecf65f714e',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1157.689475] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-4c598260-71fe-43f5-ab89-63a95724ea23 taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.689617] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4c598260-71fe-43f5-ab89-63a95724ea23" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.693259] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4c598260-71fe-43f5-ab89-63a95724ea23',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1157.697105] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a8f58709-40a0-44a2-9fc9-0e6c1122580b with status ACTIVE [ 1157.697105] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.697105] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.697105] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.697105] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.697105] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.697105] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.697105] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.697105] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.697105] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.697105] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.697105] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.697105] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.697105] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.697105] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.697105] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.697105] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a8f58709-40a0-44a2-9fc9-0e6c1122580b is going to be updated. [ 1157.715302] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.715555] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.715555] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.715676] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.715809] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.715979] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a8f58709-40a0-44a2-9fc9-0e6c1122580b" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.984505] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-12570d95-0a4a-4579-82c8-53ecf65f714e taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.984775] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-12570d95-0a4a-4579-82c8-53ecf65f714e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.984967] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b69f57d7-b3b6-43d8-854c-08d68248dd75 with status ACTIVE [ 1157.985136] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.985248] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.985312] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.985580] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.985656] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.985839] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.985925] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.985966] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.986153] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.986251] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.986433] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.986707] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.986707] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.986821] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.986853] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.986928] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b69f57d7-b3b6-43d8-854c-08d68248dd75 is going to be updated. [ 1158.005582] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.005734] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.005804] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.006069] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.006232] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.006486] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b69f57d7-b3b6-43d8-854c-08d68248dd75" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.095179] env[69188]: INFO networking_nsxv3.common.synchronization [req-40c64584-b645-48ee-97ea-c6692dfc6881 req-1266c0e4-460c-4d5d-aed9-553b2de573d7 tempest-ServerRescueNegativeTestJSON-1937748911 tempest-ServerRescueNegativeTestJSON-1937748911-project-member] Enqueued Resource ID: fa6e8a6e-b63b-4248-b67b-4ae889fac90c with Priority: HIGHEST for action security_group_members [ 1158.095474] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fa6e8a6e-b63b-4248-b67b-4ae889fac90c with Priority: HIGHEST for action security_group_members [ 1158.096111] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-fa6e8a6e-b63b-4248-b67b-4ae889fac90c taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.096111] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fa6e8a6e-b63b-4248-b67b-4ae889fac90c" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.096111] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fa6e8a6e-b63b-4248-b67b-4ae889fac90c" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.096313] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fa6e8a6e-b63b-4248-b67b-4ae889fac90c" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.096750] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.096750] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.096750] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.096750] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.096750] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.097149] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fa6e8a6e-b63b-4248-b67b-4ae889fac90c',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1158.185418] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('12570d95-0a4a-4579-82c8-53ecf65f714e',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1158.197741] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4c598260-71fe-43f5-ab89-63a95724ea23',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1158.598610] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fa6e8a6e-b63b-4248-b67b-4ae889fac90c',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1158.687574] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('12570d95-0a4a-4579-82c8-53ecf65f714e',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1158.700110] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.701912] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.701912] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.701912] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.701912] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.701912] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4c598260-71fe-43f5-ab89-63a95724ea23 is going to be updated. [ 1158.730370] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.730517] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.730589] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.730795] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.730943] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.742479] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4c598260-71fe-43f5-ab89-63a95724ea23 in Status: IN_PROGRESS for 2s [ 1159.104815] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fa6e8a6e-b63b-4248-b67b-4ae889fac90c',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1159.191170] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.191797] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.191797] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.191797] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.191797] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.191797] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 12570d95-0a4a-4579-82c8-53ecf65f714e is going to be updated. [ 1159.215917] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.216128] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.216128] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.216293] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.216440] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.225114] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 12570d95-0a4a-4579-82c8-53ecf65f714e in Status: IN_PROGRESS for 2s [ 1159.608905] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.609080] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.609140] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.609357] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.609449] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.609548] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fa6e8a6e-b63b-4248-b67b-4ae889fac90c is going to be updated. [ 1159.635401] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.635598] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.635598] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.636438] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.637391] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.646668] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fa6e8a6e-b63b-4248-b67b-4ae889fac90c in Status: IN_PROGRESS for 2s [ 1160.751956] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4c598260-71fe-43f5-ab89-63a95724ea23 in Status: SUCCESS [ 1160.752303] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4c598260-71fe-43f5-ab89-63a95724ea23" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.752516] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4c598260-71fe-43f5-ab89-63a95724ea23" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.752810] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4c598260-71fe-43f5-ab89-63a95724ea23" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.753101] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.753264] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.753362] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.753552] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.753674] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.753796] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4c598260-71fe-43f5-ab89-63a95724ea23" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.753967] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4c598260-71fe-43f5-ab89-63a95724ea23',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1161.235415] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 12570d95-0a4a-4579-82c8-53ecf65f714e in Status: SUCCESS [ 1161.235622] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-12570d95-0a4a-4579-82c8-53ecf65f714e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.235800] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-12570d95-0a4a-4579-82c8-53ecf65f714e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.236037] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-12570d95-0a4a-4579-82c8-53ecf65f714e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.236220] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.236333] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.236398] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.236542] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.236624] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.236707] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-12570d95-0a4a-4579-82c8-53ecf65f714e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.236797] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('12570d95-0a4a-4579-82c8-53ecf65f714e',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1161.256204] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4c598260-71fe-43f5-ab89-63a95724ea23',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1161.656068] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fa6e8a6e-b63b-4248-b67b-4ae889fac90c in Status: SUCCESS [ 1161.656310] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fa6e8a6e-b63b-4248-b67b-4ae889fac90c" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.738969] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-12570d95-0a4a-4579-82c8-53ecf65f714e taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.739159] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-12570d95-0a4a-4579-82c8-53ecf65f714e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.739235] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-12570d95-0a4a-4579-82c8-53ecf65f714e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.739456] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-12570d95-0a4a-4579-82c8-53ecf65f714e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.739629] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.739726] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.739793] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.739939] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.740045] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.740160] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-12570d95-0a4a-4579-82c8-53ecf65f714e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.740310] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-12570d95-0a4a-4579-82c8-53ecf65f714e taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.740402] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-12570d95-0a4a-4579-82c8-53ecf65f714e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.740465] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-12570d95-0a4a-4579-82c8-53ecf65f714e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.740606] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-12570d95-0a4a-4579-82c8-53ecf65f714e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.740742] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.740833] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.740896] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.741082] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.741183] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.741293] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-12570d95-0a4a-4579-82c8-53ecf65f714e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.741391] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('12570d95-0a4a-4579-82c8-53ecf65f714e',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1161.758185] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4c598260-71fe-43f5-ab89-63a95724ea23: rpc.has_security_group_logging(os_id): False [ 1161.775032] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.775032] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.775032] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.775234] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.775282] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.775522] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.775622] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.775688] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.775837] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.775914] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.776007] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4c598260-71fe-43f5-ab89-63a95724ea23 is going to be updated. [ 1161.827367] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.827367] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.827542] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.827824] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.828011] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.848788] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4c598260-71fe-43f5-ab89-63a95724ea23 in Status: IN_PROGRESS for 2s [ 1162.243345] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 12570d95-0a4a-4579-82c8-53ecf65f714e: rpc.has_security_group_logging(os_id): False [ 1162.262867] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.263079] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.263152] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.263345] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.264038] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.264038] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.264038] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.264038] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.264259] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.264259] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.264403] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.264517] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.264585] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.264736] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.264826] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.265123] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.265292] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.265381] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.265555] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.265641] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.265824] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 12570d95-0a4a-4579-82c8-53ecf65f714e is going to be updated. [ 1162.323022] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.323022] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.323022] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.323266] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.323330] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.336239] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 12570d95-0a4a-4579-82c8-53ecf65f714e in Status: IN_PROGRESS for 2s [ 1163.096671] env[69188]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1163.096671] env[69188]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1163.749996] env[69188]: INFO networking_nsxv3.common.synchronization [req-3ea25356-d63c-4825-9599-abc3658c64e0 req-91311300-8c68-4ae2-a146-99db4b1c3cab tempest-ServersTestJSON-1495057482 tempest-ServersTestJSON-1495057482-project-member] Enqueued Resource ID: 9f2518e8-b195-4520-b262-caa765ab7e27 with Priority: HIGHEST for action security_group_members [ 1163.750560] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f2518e8-b195-4520-b262-caa765ab7e27 with Priority: HIGHEST for action security_group_members [ 1163.751209] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-9f2518e8-b195-4520-b262-caa765ab7e27 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.751209] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9f2518e8-b195-4520-b262-caa765ab7e27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.751403] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9f2518e8-b195-4520-b262-caa765ab7e27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.751633] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9f2518e8-b195-4520-b262-caa765ab7e27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.752548] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.752548] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.752548] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.752548] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.752548] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.752548] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9f2518e8-b195-4520-b262-caa765ab7e27',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1163.862838] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4c598260-71fe-43f5-ab89-63a95724ea23 in Status: SUCCESS [ 1163.863201] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4c598260-71fe-43f5-ab89-63a95724ea23" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.255043] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.255548] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.255548] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.255548] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.255678] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.255876] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.255977] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.256053] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.256215] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.256393] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.256393] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9f2518e8-b195-4520-b262-caa765ab7e27 is going to be updated. [ 1164.282727] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.282949] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.282949] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.283283] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.283483] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.292105] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9f2518e8-b195-4520-b262-caa765ab7e27 in Status: IN_PROGRESS for 2s [ 1164.349441] env[69188]: INFO networking_nsxv3.common.synchronization [req-bdcff4df-628b-4391-9d8d-26db05a2b80f req-09737a59-c878-42d9-bc3a-169fe505af1d tempest-ServerRescueNegativeTestJSON-1937748911 tempest-ServerRescueNegativeTestJSON-1937748911-project-member] Enqueued Resource ID: fa6e8a6e-b63b-4248-b67b-4ae889fac90c with Priority: HIGHEST for action security_group_members [ 1164.349441] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fa6e8a6e-b63b-4248-b67b-4ae889fac90c with Priority: HIGHEST for action security_group_members [ 1164.349441] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-fa6e8a6e-b63b-4248-b67b-4ae889fac90c taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.349441] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fa6e8a6e-b63b-4248-b67b-4ae889fac90c" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.349441] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fa6e8a6e-b63b-4248-b67b-4ae889fac90c" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.349441] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fa6e8a6e-b63b-4248-b67b-4ae889fac90c" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.349441] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.349441] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.349441] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.349441] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.349441] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.349441] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fa6e8a6e-b63b-4248-b67b-4ae889fac90c',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1164.354047] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 12570d95-0a4a-4579-82c8-53ecf65f714e in Status: SUCCESS [ 1164.354047] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-12570d95-0a4a-4579-82c8-53ecf65f714e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.855319] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.855490] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.855538] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.856150] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.856150] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.856150] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.856150] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.856397] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.856397] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.856469] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.856502] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fa6e8a6e-b63b-4248-b67b-4ae889fac90c is going to be updated. [ 1164.885273] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.885426] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.885499] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.885715] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.885850] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.895083] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fa6e8a6e-b63b-4248-b67b-4ae889fac90c in Status: IN_PROGRESS for 2s [ 1166.300931] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9f2518e8-b195-4520-b262-caa765ab7e27 in Status: SUCCESS [ 1166.301360] env[69188]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9f2518e8-b195-4520-b262-caa765ab7e27 deletion is rescheduled due to dependency. [ 1166.301360] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9f2518e8-b195-4520-b262-caa765ab7e27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.913822] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fa6e8a6e-b63b-4248-b67b-4ae889fac90c in Status: SUCCESS [ 1166.913954] env[69188]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fa6e8a6e-b63b-4248-b67b-4ae889fac90c deletion is rescheduled due to dependency. [ 1166.913954] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fa6e8a6e-b63b-4248-b67b-4ae889fac90c" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.348294] env[69188]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1169.348706] env[69188]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1170.122022] env[69188]: INFO networking_nsxv3.common.synchronization [req-9b6242cf-3819-4709-839f-6bc34a62d59d req-e129b9f7-2ef3-4889-9033-1df55f1f76a3 tempest-AttachInterfacesTestJSON-1255877948 tempest-AttachInterfacesTestJSON-1255877948-project-member] Enqueued Resource ID: 12570d95-0a4a-4579-82c8-53ecf65f714e with Priority: HIGHEST for action security_group_members [ 1170.122565] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 12570d95-0a4a-4579-82c8-53ecf65f714e with Priority: HIGHEST for action security_group_members [ 1170.122869] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-12570d95-0a4a-4579-82c8-53ecf65f714e taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.123019] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-12570d95-0a4a-4579-82c8-53ecf65f714e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.123305] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-12570d95-0a4a-4579-82c8-53ecf65f714e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.123547] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-12570d95-0a4a-4579-82c8-53ecf65f714e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.123717] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.123822] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.123892] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.124050] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.124139] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.124229] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('12570d95-0a4a-4579-82c8-53ecf65f714e',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1170.626651] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('12570d95-0a4a-4579-82c8-53ecf65f714e',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1171.128836] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('12570d95-0a4a-4579-82c8-53ecf65f714e',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1171.260615] env[69188]: INFO networking_nsxv3.common.synchronization [None req-06df8f0e-5478-4e56-85da-00585bf8e50c tempest-AttachInterfacesTestJSON-1255877948 tempest-AttachInterfacesTestJSON-1255877948-project-member] Enqueued Resource ID: 12570d95-0a4a-4579-82c8-53ecf65f714e with Priority: HIGHEST for action security_group_members [ 1171.260615] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 12570d95-0a4a-4579-82c8-53ecf65f714e with Priority: HIGHEST for action security_group_members [ 1171.260615] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-12570d95-0a4a-4579-82c8-53ecf65f714e taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.260615] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-12570d95-0a4a-4579-82c8-53ecf65f714e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.632403] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.632671] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.632671] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.632865] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.632972] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.633086] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 12570d95-0a4a-4579-82c8-53ecf65f714e is going to be updated. [ 1171.662602] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.663882] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.663976] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.664238] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.664799] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.674455] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 12570d95-0a4a-4579-82c8-53ecf65f714e in Status: IN_PROGRESS for 2s [ 1173.691801] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 12570d95-0a4a-4579-82c8-53ecf65f714e in Status: SUCCESS [ 1173.691801] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-12570d95-0a4a-4579-82c8-53ecf65f714e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.691801] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-12570d95-0a4a-4579-82c8-53ecf65f714e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.691801] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-12570d95-0a4a-4579-82c8-53ecf65f714e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.691801] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.691801] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.691801] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.691801] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.691801] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.691801] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('12570d95-0a4a-4579-82c8-53ecf65f714e',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1173.906181] env[69188]: INFO networking_nsxv3.common.synchronization [None req-9860588d-2e01-44cb-8f91-bd31fdf839e9 None None] Enqueued Resource ID: 2ec486f4-8f28-47c7-91b0-1ce2ebe5de2b with Priority: HIGHEST for action port [ 1173.906304] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ec486f4-8f28-47c7-91b0-1ce2ebe5de2b with Priority: HIGHEST for action port [ 1173.906605] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-2ec486f4-8f28-47c7-91b0-1ce2ebe5de2b taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.906721] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2ec486f4-8f28-47c7-91b0-1ce2ebe5de2b" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.909473] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2ec486f4-8f28-47c7-91b0-1ce2ebe5de2b" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.909473] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2ec486f4-8f28-47c7-91b0-1ce2ebe5de2b" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.909473] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2ec486f4-8f28-47c7-91b0-1ce2ebe5de2b',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1174.197033] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.197033] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.197033] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.197310] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.197416] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.197629] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.198399] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.198399] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.198399] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.198399] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.198399] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 12570d95-0a4a-4579-82c8-53ecf65f714e is going to be updated. [ 1174.222684] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.222896] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.222896] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.223105] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.223309] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.230632] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 12570d95-0a4a-4579-82c8-53ecf65f714e in Status: IN_PROGRESS for 2s [ 1174.409323] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2ec486f4-8f28-47c7-91b0-1ce2ebe5de2b [ 1174.409546] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.409691] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.409756] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.409971] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.410077] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.410179] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2ec486f4-8f28-47c7-91b0-1ce2ebe5de2b already deleted. [ 1174.410258] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2ec486f4-8f28-47c7-91b0-1ce2ebe5de2b" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.034292] env[69188]: INFO networking_nsxv3.common.synchronization [None req-d5aabb73-aa19-44ff-a2da-6f6a4879b79b None None] Enqueued Resource ID: 4b4495d0-fe89-4db0-9b3e-163b0cb75043 with Priority: HIGHEST for action port [ 1176.034807] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4b4495d0-fe89-4db0-9b3e-163b0cb75043 with Priority: HIGHEST for action port [ 1176.035125] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-4b4495d0-fe89-4db0-9b3e-163b0cb75043 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.035248] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4b4495d0-fe89-4db0-9b3e-163b0cb75043" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.035307] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4b4495d0-fe89-4db0-9b3e-163b0cb75043" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.035565] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4b4495d0-fe89-4db0-9b3e-163b0cb75043" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.035667] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4b4495d0-fe89-4db0-9b3e-163b0cb75043',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1176.240597] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 12570d95-0a4a-4579-82c8-53ecf65f714e in Status: SUCCESS [ 1176.240977] env[69188]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 12570d95-0a4a-4579-82c8-53ecf65f714e deletion is rescheduled due to dependency. [ 1176.240977] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-12570d95-0a4a-4579-82c8-53ecf65f714e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.538359] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4b4495d0-fe89-4db0-9b3e-163b0cb75043 [ 1176.538359] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.538531] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.538578] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.539539] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.539539] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.539539] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4b4495d0-fe89-4db0-9b3e-163b0cb75043 already deleted. [ 1176.539539] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4b4495d0-fe89-4db0-9b3e-163b0cb75043" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.997328] env[69188]: INFO networking_nsxv3.common.synchronization [req-7127a8d9-de3e-4c40-90bf-19f836933c20 req-982c58b4-99a7-4c38-a28c-27b30b0dafa7 tempest-ServersNegativeTestJSON-5747953 tempest-ServersNegativeTestJSON-5747953-project-member] Enqueued Resource ID: 938f39e5-b2c4-4a5d-b8ea-03c277953ec9 with Priority: HIGHEST for action security_group_members [ 1176.997908] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 938f39e5-b2c4-4a5d-b8ea-03c277953ec9 with Priority: HIGHEST for action security_group_members [ 1176.998565] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-938f39e5-b2c4-4a5d-b8ea-03c277953ec9 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.998565] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-938f39e5-b2c4-4a5d-b8ea-03c277953ec9" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.998565] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-938f39e5-b2c4-4a5d-b8ea-03c277953ec9" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.998765] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-938f39e5-b2c4-4a5d-b8ea-03c277953ec9" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.998765] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.998941] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.998941] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.999202] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.999202] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.999356] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('938f39e5-b2c4-4a5d-b8ea-03c277953ec9',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1177.505147] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.505514] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.505514] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.505669] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.505860] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.506144] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.506351] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.506478] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.506698] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.506812] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.506966] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 938f39e5-b2c4-4a5d-b8ea-03c277953ec9 is going to be updated. [ 1177.531024] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.531024] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.531024] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.531546] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.531546] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.539630] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 938f39e5-b2c4-4a5d-b8ea-03c277953ec9 in Status: IN_PROGRESS for 2s [ 1179.550265] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 938f39e5-b2c4-4a5d-b8ea-03c277953ec9 in Status: SUCCESS [ 1179.550610] env[69188]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 938f39e5-b2c4-4a5d-b8ea-03c277953ec9 deletion is rescheduled due to dependency. [ 1179.550610] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-938f39e5-b2c4-4a5d-b8ea-03c277953ec9" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.055264] env[69188]: INFO networking_nsxv3.common.synchronization [req-5240b83c-fd65-4c5f-b95a-565730c9aacc req-d9e270df-4ade-4cf3-affb-eb4273edb0bb tempest-AttachInterfacesTestJSON-1255877948 tempest-AttachInterfacesTestJSON-1255877948-project-member] Enqueued Resource ID: 0ba9367f-1279-4e82-9eaa-4519ee3a1efb with Priority: HIGHEST for action security_group_members [ 1180.055838] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0ba9367f-1279-4e82-9eaa-4519ee3a1efb with Priority: HIGHEST for action security_group_members [ 1180.056174] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-0ba9367f-1279-4e82-9eaa-4519ee3a1efb taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.056300] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0ba9367f-1279-4e82-9eaa-4519ee3a1efb" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.056365] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0ba9367f-1279-4e82-9eaa-4519ee3a1efb" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.056610] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0ba9367f-1279-4e82-9eaa-4519ee3a1efb" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.056765] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.056906] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.056960] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.057167] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.057247] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.057339] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0ba9367f-1279-4e82-9eaa-4519ee3a1efb',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1180.560178] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.560474] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.560474] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.560549] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.560634] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.560819] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.560917] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.560980] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.561151] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.561227] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.561406] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0ba9367f-1279-4e82-9eaa-4519ee3a1efb is going to be updated. [ 1180.591814] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.591814] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.591814] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.591814] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.591814] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.599876] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0ba9367f-1279-4e82-9eaa-4519ee3a1efb in Status: IN_PROGRESS for 2s [ 1181.190181] env[69188]: INFO networking_nsxv3.common.synchronization [req-5d48eb56-da06-4f43-bd4c-969a99582120 req-cf626afe-0950-4a1b-b8be-0c5555aad0cd tempest-ServerTagsTestJSON-393677794 tempest-ServerTagsTestJSON-393677794-project-member] Enqueued Resource ID: e5ba8b1f-5099-48fb-8bd0-c413eb3b39f7 with Priority: HIGHEST for action security_group_members [ 1181.190715] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e5ba8b1f-5099-48fb-8bd0-c413eb3b39f7 with Priority: HIGHEST for action security_group_members [ 1181.191017] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-e5ba8b1f-5099-48fb-8bd0-c413eb3b39f7 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.191148] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e5ba8b1f-5099-48fb-8bd0-c413eb3b39f7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.191239] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e5ba8b1f-5099-48fb-8bd0-c413eb3b39f7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.191518] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e5ba8b1f-5099-48fb-8bd0-c413eb3b39f7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.191674] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.191782] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.191848] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.191976] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.192062] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.192155] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e5ba8b1f-5099-48fb-8bd0-c413eb3b39f7',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1181.485574] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock network-951 taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.485789] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "network-951" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.485947] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "network-951" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.486280] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "network-951" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.486552] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.486716] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.486838] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.487063] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.487226] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.487664] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1181.487664] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] NeedRegenerationException {{(pid=69188) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1181.487738] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] no value, waiting for create lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1181.487800] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] value creation lock acquired {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1181.487952] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1181.488111] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Calling creation function for not-yet-present value {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1181.488262] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1181.506755] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1181.506912] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69188) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1181.507061] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Released creation lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1181.507234] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "network-951" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.507525] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock port-476b32c2-7836-456d-b638-a233894f03ce taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.507695] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "port-476b32c2-7836-456d-b638-a233894f03ce" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.507824] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "port-476b32c2-7836-456d-b638-a233894f03ce" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.508134] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "port-476b32c2-7836-456d-b638-a233894f03ce" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.508276] env[69188]: DEBUG networking_nsxv3.api.rpc [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('476b32c2-7836-456d-b638-a233894f03ce',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1181.694180] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.694550] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.694550] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.694648] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.694755] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.694909] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.695521] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.695521] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.695521] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.695521] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.695521] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e5ba8b1f-5099-48fb-8bd0-c413eb3b39f7 already deleted. [ 1181.695521] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e5ba8b1f-5099-48fb-8bd0-c413eb3b39f7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.010394] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.010803] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.010943] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.011250] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.011433] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.011601] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Segment Port 476b32c2-7836-456d-b638-a233894f03ce not found, creating... [ 1182.011874] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.012049] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.012174] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.012401] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.012545] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.012831] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.012986] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.013164] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.013374] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.013513] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.013655] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Resource: SegmentPort with ID: 476b32c2-7836-456d-b638-a233894f03ce is going to be created. [ 1182.034107] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.034316] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.034449] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.034770] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.035048] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.035283] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "port-476b32c2-7836-456d-b638-a233894f03ce" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.610147] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0ba9367f-1279-4e82-9eaa-4519ee3a1efb in Status: SUCCESS [ 1182.610147] env[69188]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0ba9367f-1279-4e82-9eaa-4519ee3a1efb deletion is rescheduled due to dependency. [ 1182.610147] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0ba9367f-1279-4e82-9eaa-4519ee3a1efb" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.958277] env[69188]: INFO networking_nsxv3.common.synchronization [req-5d48eb56-da06-4f43-bd4c-969a99582120 req-d6b76352-d313-4fea-909b-6b57d06958e2 service nova] Enqueued Resource ID: e5ba8b1f-5099-48fb-8bd0-c413eb3b39f7 with Priority: HIGHEST for action security_group_rules [ 1182.958277] env[69188]: INFO networking_nsxv3.common.synchronization [req-5d48eb56-da06-4f43-bd4c-969a99582120 req-d6b76352-d313-4fea-909b-6b57d06958e2 service nova] Enqueued Resource ID: e5ba8b1f-5099-48fb-8bd0-c413eb3b39f7 with Priority: HIGHEST for action security_group_members [ 1182.958277] env[69188]: INFO networking_nsxv3.common.synchronization [req-5d48eb56-da06-4f43-bd4c-969a99582120 req-d6b76352-d313-4fea-909b-6b57d06958e2 service nova] Enqueued Resource ID: 476b32c2-7836-456d-b638-a233894f03ce with Priority: HIGHEST for action port [ 1182.958277] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e5ba8b1f-5099-48fb-8bd0-c413eb3b39f7 with Priority: HIGHEST for action security_group_rules [ 1182.958277] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e5ba8b1f-5099-48fb-8bd0-c413eb3b39f7 with Priority: HIGHEST for action security_group_members [ 1182.958277] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 476b32c2-7836-456d-b638-a233894f03ce with Priority: HIGHEST for action port [ 1182.958277] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e5ba8b1f-5099-48fb-8bd0-c413eb3b39f7 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.958277] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e5ba8b1f-5099-48fb-8bd0-c413eb3b39f7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.958277] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e5ba8b1f-5099-48fb-8bd0-c413eb3b39f7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.958277] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e5ba8b1f-5099-48fb-8bd0-c413eb3b39f7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.958277] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e5ba8b1f-5099-48fb-8bd0-c413eb3b39f7',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1182.961502] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-e5ba8b1f-5099-48fb-8bd0-c413eb3b39f7 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.961757] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e5ba8b1f-5099-48fb-8bd0-c413eb3b39f7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.961913] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e5ba8b1f-5099-48fb-8bd0-c413eb3b39f7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.962284] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e5ba8b1f-5099-48fb-8bd0-c413eb3b39f7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.962510] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.962726] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.962886] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.963251] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.963689] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.964356] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e5ba8b1f-5099-48fb-8bd0-c413eb3b39f7',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1182.965330] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-476b32c2-7836-456d-b638-a233894f03ce taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.965570] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-476b32c2-7836-456d-b638-a233894f03ce" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.965729] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-476b32c2-7836-456d-b638-a233894f03ce" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.965981] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-476b32c2-7836-456d-b638-a233894f03ce" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.967396] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('476b32c2-7836-456d-b638-a233894f03ce',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1183.468827] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e5ba8b1f-5099-48fb-8bd0-c413eb3b39f7',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1183.469886] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-e5ba8b1f-5099-48fb-8bd0-c413eb3b39f7 taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.470032] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e5ba8b1f-5099-48fb-8bd0-c413eb3b39f7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.470176] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 476b32c2-7836-456d-b638-a233894f03ce with status ACTIVE [ 1183.470337] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.470441] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.470500] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.470698] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.470798] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.470973] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.471109] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.471191] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.471298] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.471394] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.471586] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.471684] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.471743] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.472328] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.475587] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.475587] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 476b32c2-7836-456d-b638-a233894f03ce is going to be updated. [ 1183.495940] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.496180] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.496285] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.496582] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.496779] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.497032] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-476b32c2-7836-456d-b638-a233894f03ce" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.974913] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e5ba8b1f-5099-48fb-8bd0-c413eb3b39f7',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1184.477310] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.477555] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.477555] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.477775] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.477908] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.478030] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e5ba8b1f-5099-48fb-8bd0-c413eb3b39f7 is going to be created. [ 1184.502679] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.502828] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.502890] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.503108] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.503276] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.512651] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e5ba8b1f-5099-48fb-8bd0-c413eb3b39f7 in Status: UNINITIALIZED for 2s [ 1186.499898] env[69188]: INFO networking_nsxv3.common.synchronization [None req-42d1703f-cc4e-4583-bdea-2410649e0280 tempest-AttachInterfacesTestJSON-1255877948 tempest-AttachInterfacesTestJSON-1255877948-project-member] Enqueued Resource ID: 2a389e0c-0be3-41c9-986c-f4b06040a24d with Priority: HIGHEST for action security_group_rules [ 1186.500484] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2a389e0c-0be3-41c9-986c-f4b06040a24d with Priority: HIGHEST for action security_group_rules [ 1186.500793] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2a389e0c-0be3-41c9-986c-f4b06040a24d taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.500916] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2a389e0c-0be3-41c9-986c-f4b06040a24d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.500985] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2a389e0c-0be3-41c9-986c-f4b06040a24d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.501448] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2a389e0c-0be3-41c9-986c-f4b06040a24d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.501510] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2a389e0c-0be3-41c9-986c-f4b06040a24d',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1186.523440] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e5ba8b1f-5099-48fb-8bd0-c413eb3b39f7 in Status: SUCCESS [ 1186.523639] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e5ba8b1f-5099-48fb-8bd0-c413eb3b39f7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.523789] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e5ba8b1f-5099-48fb-8bd0-c413eb3b39f7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.523990] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e5ba8b1f-5099-48fb-8bd0-c413eb3b39f7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.524189] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.524304] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.524371] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.524624] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.524624] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.524751] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e5ba8b1f-5099-48fb-8bd0-c413eb3b39f7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.524784] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e5ba8b1f-5099-48fb-8bd0-c413eb3b39f7',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1186.564859] env[69188]: INFO networking_nsxv3.common.synchronization [None req-0cb4562f-02d8-4582-9a23-754932addafb tempest-AttachInterfacesTestJSON-1255877948 tempest-AttachInterfacesTestJSON-1255877948-project-member] Enqueued Resource ID: 2a389e0c-0be3-41c9-986c-f4b06040a24d with Priority: HIGHEST for action security_group_rules [ 1186.564859] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2a389e0c-0be3-41c9-986c-f4b06040a24d with Priority: HIGHEST for action security_group_rules [ 1186.564859] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2a389e0c-0be3-41c9-986c-f4b06040a24d taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.564859] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2a389e0c-0be3-41c9-986c-f4b06040a24d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.020267] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.020529] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.020529] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.020808] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.020920] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.021094] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2a389e0c-0be3-41c9-986c-f4b06040a24d already deleted. [ 1187.021206] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2a389e0c-0be3-41c9-986c-f4b06040a24d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.021393] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2a389e0c-0be3-41c9-986c-f4b06040a24d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.021625] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2a389e0c-0be3-41c9-986c-f4b06040a24d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.021742] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2a389e0c-0be3-41c9-986c-f4b06040a24d',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1187.026561] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-e5ba8b1f-5099-48fb-8bd0-c413eb3b39f7 taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.026727] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e5ba8b1f-5099-48fb-8bd0-c413eb3b39f7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.026797] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e5ba8b1f-5099-48fb-8bd0-c413eb3b39f7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.027039] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e5ba8b1f-5099-48fb-8bd0-c413eb3b39f7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.027228] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.027338] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.027422] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.027551] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.027638] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.027707] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e5ba8b1f-5099-48fb-8bd0-c413eb3b39f7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.027882] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-e5ba8b1f-5099-48fb-8bd0-c413eb3b39f7 taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.027985] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e5ba8b1f-5099-48fb-8bd0-c413eb3b39f7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.028111] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e5ba8b1f-5099-48fb-8bd0-c413eb3b39f7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.028199] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e5ba8b1f-5099-48fb-8bd0-c413eb3b39f7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.028443] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.028443] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.028560] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.028634] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.028729] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.028800] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e5ba8b1f-5099-48fb-8bd0-c413eb3b39f7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.028889] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e5ba8b1f-5099-48fb-8bd0-c413eb3b39f7',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1187.530525] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e5ba8b1f-5099-48fb-8bd0-c413eb3b39f7: rpc.has_security_group_logging(os_id): False [ 1187.540585] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.540718] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.540792] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.540986] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.541082] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.541173] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2a389e0c-0be3-41c9-986c-f4b06040a24d already deleted. [ 1187.541252] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2a389e0c-0be3-41c9-986c-f4b06040a24d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.543955] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.544100] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.544138] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.544297] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.544380] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.544551] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.544647] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.544707] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.544846] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.544921] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.545128] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.545222] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.545284] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.545422] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.545498] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.545672] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.545763] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.545820] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.545955] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.546042] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.546123] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e5ba8b1f-5099-48fb-8bd0-c413eb3b39f7 is going to be created. [ 1187.602131] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.602281] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.602322] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.602468] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.602636] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.611496] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e5ba8b1f-5099-48fb-8bd0-c413eb3b39f7 in Status: IN_PROGRESS for 2s [ 1188.200575] env[69188]: INFO networking_nsxv3.common.synchronization [req-4358ab61-6258-4791-a2c4-724ef5750145 req-cc99ccfd-898d-4eba-bc85-374f421a69d6 tempest-ServerActionsTestOtherB-2131451762 tempest-ServerActionsTestOtherB-2131451762-project-member] Enqueued Resource ID: 867581e0-cbbd-4108-a823-0b7c53d47c3a with Priority: HIGHEST for action security_group_members [ 1188.201199] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 867581e0-cbbd-4108-a823-0b7c53d47c3a with Priority: HIGHEST for action security_group_members [ 1188.201556] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-867581e0-cbbd-4108-a823-0b7c53d47c3a taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.201702] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-867581e0-cbbd-4108-a823-0b7c53d47c3a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.201769] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-867581e0-cbbd-4108-a823-0b7c53d47c3a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.202013] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-867581e0-cbbd-4108-a823-0b7c53d47c3a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.202142] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.202249] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.202311] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.202602] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.202716] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.202807] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('867581e0-cbbd-4108-a823-0b7c53d47c3a',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1188.704534] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.704846] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.704846] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.705340] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.705340] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.705340] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.705520] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.705520] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.705590] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.705654] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.705901] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 867581e0-cbbd-4108-a823-0b7c53d47c3a is going to be updated. [ 1188.737044] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.737173] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.737239] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.737432] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.737588] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.751348] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 867581e0-cbbd-4108-a823-0b7c53d47c3a in Status: IN_PROGRESS for 2s [ 1189.622434] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e5ba8b1f-5099-48fb-8bd0-c413eb3b39f7 in Status: SUCCESS [ 1189.622696] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e5ba8b1f-5099-48fb-8bd0-c413eb3b39f7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.761994] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 867581e0-cbbd-4108-a823-0b7c53d47c3a in Status: SUCCESS [ 1190.762300] env[69188]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 867581e0-cbbd-4108-a823-0b7c53d47c3a deletion is rescheduled due to dependency. [ 1190.762300] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-867581e0-cbbd-4108-a823-0b7c53d47c3a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.959942] env[69188]: INFO networking_nsxv3.common.synchronization [req-942642a4-ede1-4b89-ba18-d4a9de155ab1 req-b2121e73-da43-4171-9905-244822e39bc8 tempest-AttachInterfacesTestJSON-1255877948 tempest-AttachInterfacesTestJSON-1255877948-project-member] Enqueued Resource ID: 2a389e0c-0be3-41c9-986c-f4b06040a24d with Priority: HIGHEST for action security_group_members [ 1191.960231] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2a389e0c-0be3-41c9-986c-f4b06040a24d with Priority: HIGHEST for action security_group_members [ 1191.960486] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-2a389e0c-0be3-41c9-986c-f4b06040a24d taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.960609] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2a389e0c-0be3-41c9-986c-f4b06040a24d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.960678] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2a389e0c-0be3-41c9-986c-f4b06040a24d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.960932] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2a389e0c-0be3-41c9-986c-f4b06040a24d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.961550] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.961667] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.961718] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.961882] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.961990] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.962172] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2a389e0c-0be3-41c9-986c-f4b06040a24d',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1192.228128] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock network-51 taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.228338] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "network-51" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.228488] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "network-51" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.228787] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "network-51" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.229072] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.229236] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.229393] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.229653] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.229828] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.230150] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1192.230321] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] NeedRegenerationException {{(pid=69188) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1192.231028] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] no value, waiting for create lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1192.231028] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] value creation lock acquired {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1192.231028] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1192.231216] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Calling creation function for not-yet-present value {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1192.231375] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1192.251801] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1192.251961] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69188) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1192.252136] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Released creation lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1192.252366] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "network-51" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.252645] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock port-b0c2e560-4ff0-43af-ab72-3b3ad36b8ce2 taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.252815] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "port-b0c2e560-4ff0-43af-ab72-3b3ad36b8ce2" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.252940] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "port-b0c2e560-4ff0-43af-ab72-3b3ad36b8ce2" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.253257] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "port-b0c2e560-4ff0-43af-ab72-3b3ad36b8ce2" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.253397] env[69188]: DEBUG networking_nsxv3.api.rpc [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b0c2e560-4ff0-43af-ab72-3b3ad36b8ce2',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1192.464488] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.465279] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.466067] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.466151] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.466283] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.466439] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.466627] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.466702] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.466818] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.466941] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.467153] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2a389e0c-0be3-41c9-986c-f4b06040a24d already deleted. [ 1192.467153] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2a389e0c-0be3-41c9-986c-f4b06040a24d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.755368] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.755646] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.755723] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.756023] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.756169] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.756333] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Segment Port b0c2e560-4ff0-43af-ab72-3b3ad36b8ce2 not found, creating... [ 1192.756600] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.756764] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.756880] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.757138] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.757592] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.757592] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.757804] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.757986] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.758224] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.758364] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.758508] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Resource: SegmentPort with ID: b0c2e560-4ff0-43af-ab72-3b3ad36b8ce2 is going to be created. [ 1192.777912] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.778149] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.778282] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.778552] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.778787] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.779014] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "port-b0c2e560-4ff0-43af-ab72-3b3ad36b8ce2" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.179631] env[69188]: INFO networking_nsxv3.common.synchronization [req-42ea79bf-8ba5-4e3c-b22e-7225738a427a req-29462239-8805-4284-9571-c6ef4f873d06 tempest-ServerTagsTestJSON-393677794 tempest-ServerTagsTestJSON-393677794-project-member] Enqueued Resource ID: e5ba8b1f-5099-48fb-8bd0-c413eb3b39f7 with Priority: HIGHEST for action security_group_members [ 1193.180169] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e5ba8b1f-5099-48fb-8bd0-c413eb3b39f7 with Priority: HIGHEST for action security_group_members [ 1193.180471] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-e5ba8b1f-5099-48fb-8bd0-c413eb3b39f7 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.180594] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e5ba8b1f-5099-48fb-8bd0-c413eb3b39f7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.180661] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e5ba8b1f-5099-48fb-8bd0-c413eb3b39f7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.180974] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e5ba8b1f-5099-48fb-8bd0-c413eb3b39f7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.181145] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.181294] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.181330] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.181443] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.181555] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.181656] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e5ba8b1f-5099-48fb-8bd0-c413eb3b39f7',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1193.683856] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.684000] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.684083] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.684294] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.684388] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.684577] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.684674] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.684774] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.684875] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.684950] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.685051] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e5ba8b1f-5099-48fb-8bd0-c413eb3b39f7 is going to be updated. [ 1193.686622] env[69188]: INFO networking_nsxv3.common.synchronization [req-942642a4-ede1-4b89-ba18-d4a9de155ab1 req-f2f7b534-1ec5-4df4-b402-19698a0ce7d7 service nova] Enqueued Resource ID: 2a389e0c-0be3-41c9-986c-f4b06040a24d with Priority: HIGHEST for action security_group_rules [ 1193.686796] env[69188]: INFO networking_nsxv3.common.synchronization [req-942642a4-ede1-4b89-ba18-d4a9de155ab1 req-f2f7b534-1ec5-4df4-b402-19698a0ce7d7 service nova] Enqueued Resource ID: 2a389e0c-0be3-41c9-986c-f4b06040a24d with Priority: HIGHEST for action security_group_members [ 1193.687091] env[69188]: INFO networking_nsxv3.common.synchronization [req-942642a4-ede1-4b89-ba18-d4a9de155ab1 req-f2f7b534-1ec5-4df4-b402-19698a0ce7d7 service nova] Enqueued Resource ID: b0c2e560-4ff0-43af-ab72-3b3ad36b8ce2 with Priority: HIGHEST for action port [ 1193.687605] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2a389e0c-0be3-41c9-986c-f4b06040a24d with Priority: HIGHEST for action security_group_rules [ 1193.687741] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2a389e0c-0be3-41c9-986c-f4b06040a24d with Priority: HIGHEST for action security_group_members [ 1193.687825] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b0c2e560-4ff0-43af-ab72-3b3ad36b8ce2 with Priority: HIGHEST for action port [ 1193.688489] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2a389e0c-0be3-41c9-986c-f4b06040a24d taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.688604] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2a389e0c-0be3-41c9-986c-f4b06040a24d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.688684] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2a389e0c-0be3-41c9-986c-f4b06040a24d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.688855] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2a389e0c-0be3-41c9-986c-f4b06040a24d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.688969] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2a389e0c-0be3-41c9-986c-f4b06040a24d',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1193.691032] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-2a389e0c-0be3-41c9-986c-f4b06040a24d taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.691032] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2a389e0c-0be3-41c9-986c-f4b06040a24d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.691032] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2a389e0c-0be3-41c9-986c-f4b06040a24d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.691032] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2a389e0c-0be3-41c9-986c-f4b06040a24d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.691032] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.691032] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.691032] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.691032] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.691032] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.691032] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2a389e0c-0be3-41c9-986c-f4b06040a24d',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1193.691414] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-b0c2e560-4ff0-43af-ab72-3b3ad36b8ce2 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.691486] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b0c2e560-4ff0-43af-ab72-3b3ad36b8ce2" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.691532] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b0c2e560-4ff0-43af-ab72-3b3ad36b8ce2" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.691790] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b0c2e560-4ff0-43af-ab72-3b3ad36b8ce2" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.691790] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b0c2e560-4ff0-43af-ab72-3b3ad36b8ce2',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1193.714025] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.714159] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.714159] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.714328] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.714470] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.723448] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e5ba8b1f-5099-48fb-8bd0-c413eb3b39f7 in Status: IN_PROGRESS for 2s [ 1194.193926] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-2a389e0c-0be3-41c9-986c-f4b06040a24d taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.194217] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2a389e0c-0be3-41c9-986c-f4b06040a24d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.194305] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2a389e0c-0be3-41c9-986c-f4b06040a24d',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1194.196042] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b0c2e560-4ff0-43af-ab72-3b3ad36b8ce2 with status ACTIVE [ 1194.196198] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.196328] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.196377] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.196561] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.196656] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.196842] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.196958] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.197016] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.197212] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.197267] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.197504] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.197504] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.197619] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.197677] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.197753] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.197848] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b0c2e560-4ff0-43af-ab72-3b3ad36b8ce2 is going to be updated. [ 1194.224254] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.224468] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.224527] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.224803] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.224968] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.225173] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b0c2e560-4ff0-43af-ab72-3b3ad36b8ce2" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.696426] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2a389e0c-0be3-41c9-986c-f4b06040a24d',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1195.198291] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.198564] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.198564] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.198760] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.198858] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.198964] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2a389e0c-0be3-41c9-986c-f4b06040a24d is going to be created. [ 1195.225456] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.225456] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.225456] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.225456] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.225456] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.234051] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2a389e0c-0be3-41c9-986c-f4b06040a24d in Status: UNINITIALIZED for 2s [ 1195.736937] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e5ba8b1f-5099-48fb-8bd0-c413eb3b39f7 in Status: SUCCESS [ 1195.737123] env[69188]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e5ba8b1f-5099-48fb-8bd0-c413eb3b39f7 deletion is rescheduled due to dependency. [ 1195.737185] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e5ba8b1f-5099-48fb-8bd0-c413eb3b39f7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.243177] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2a389e0c-0be3-41c9-986c-f4b06040a24d in Status: SUCCESS [ 1197.243540] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2a389e0c-0be3-41c9-986c-f4b06040a24d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.243704] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2a389e0c-0be3-41c9-986c-f4b06040a24d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.243927] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2a389e0c-0be3-41c9-986c-f4b06040a24d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.244140] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.244260] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.244328] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.244486] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.244566] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.244655] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2a389e0c-0be3-41c9-986c-f4b06040a24d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.244748] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2a389e0c-0be3-41c9-986c-f4b06040a24d',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1197.747569] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2a389e0c-0be3-41c9-986c-f4b06040a24d',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1198.124687] env[69188]: INFO networking_nsxv3.common.synchronization [req-416baa7b-64d2-40e4-949e-437dc4aef7b0 req-2f9985f0-352c-4a2a-89bb-f22eeae28d0e tempest-ServerActionsTestOtherB-2131451762 tempest-ServerActionsTestOtherB-2131451762-project-member] Enqueued Resource ID: 867581e0-cbbd-4108-a823-0b7c53d47c3a with Priority: HIGHEST for action security_group_members [ 1198.125195] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 867581e0-cbbd-4108-a823-0b7c53d47c3a with Priority: HIGHEST for action security_group_members [ 1198.125511] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-867581e0-cbbd-4108-a823-0b7c53d47c3a taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.125625] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-867581e0-cbbd-4108-a823-0b7c53d47c3a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.125687] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-867581e0-cbbd-4108-a823-0b7c53d47c3a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.125979] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-867581e0-cbbd-4108-a823-0b7c53d47c3a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.126060] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.126188] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.126246] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.126347] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.126427] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.126519] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('867581e0-cbbd-4108-a823-0b7c53d47c3a',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1198.251505] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2a389e0c-0be3-41c9-986c-f4b06040a24d: rpc.has_security_group_logging(os_id): False [ 1198.269072] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.269072] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.269072] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.269072] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.269072] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.269072] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.269072] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.269072] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.269072] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.269072] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.269072] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2a389e0c-0be3-41c9-986c-f4b06040a24d is going to be created. [ 1198.326565] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.326565] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.326565] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.326565] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.326565] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.335382] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2a389e0c-0be3-41c9-986c-f4b06040a24d in Status: IN_PROGRESS for 2s [ 1198.454475] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock network-154 taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.454475] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "network-154" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.454475] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "network-154" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.454932] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "network-154" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.455239] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.455401] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.455516] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.455743] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.455900] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.456191] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1198.456329] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] NeedRegenerationException {{(pid=69188) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1198.456371] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] no value, waiting for create lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1198.456463] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] value creation lock acquired {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1198.456576] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1198.456707] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Calling creation function for not-yet-present value {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1198.456848] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1198.486552] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1198.486731] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Cache value generated in 0.030 seconds for key(s): 'zone-id' {{(pid=69188) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1198.486889] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Released creation lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1198.487066] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "network-154" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.487409] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock port-0bf18a15-bdc8-4dc8-a0f7-514d44d02d6e taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.487637] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "port-0bf18a15-bdc8-4dc8-a0f7-514d44d02d6e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.487768] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "port-0bf18a15-bdc8-4dc8-a0f7-514d44d02d6e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.488149] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "port-0bf18a15-bdc8-4dc8-a0f7-514d44d02d6e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.488295] env[69188]: DEBUG networking_nsxv3.api.rpc [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0bf18a15-bdc8-4dc8-a0f7-514d44d02d6e',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1198.628430] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.628627] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.628700] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.628856] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.628955] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.629160] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.629267] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.629329] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.629486] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.629563] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.629652] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 867581e0-cbbd-4108-a823-0b7c53d47c3a is going to be updated. [ 1198.652180] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.652371] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.652371] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.652569] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.652723] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.660403] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 867581e0-cbbd-4108-a823-0b7c53d47c3a in Status: IN_PROGRESS for 2s [ 1198.990692] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.990903] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.990942] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.991262] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.991422] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.991604] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Segment Port 0bf18a15-bdc8-4dc8-a0f7-514d44d02d6e not found, creating... [ 1198.991869] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.992045] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.992169] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.992396] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.992540] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.992889] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.993087] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.993215] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.993430] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.993569] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.993712] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Resource: SegmentPort with ID: 0bf18a15-bdc8-4dc8-a0f7-514d44d02d6e is going to be created. [ 1199.014058] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.014330] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.014466] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.014752] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.015015] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.015268] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "port-0bf18a15-bdc8-4dc8-a0f7-514d44d02d6e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.685755] env[69188]: INFO networking_nsxv3.common.synchronization [req-416baa7b-64d2-40e4-949e-437dc4aef7b0 req-c3f943f1-aff3-49cf-9dfa-613bd725931f service nova] Enqueued Resource ID: 867581e0-cbbd-4108-a823-0b7c53d47c3a with Priority: HIGHEST for action security_group_rules [ 1199.686130] env[69188]: INFO networking_nsxv3.common.synchronization [req-416baa7b-64d2-40e4-949e-437dc4aef7b0 req-c3f943f1-aff3-49cf-9dfa-613bd725931f service nova] Enqueued Resource ID: 867581e0-cbbd-4108-a823-0b7c53d47c3a with Priority: HIGHEST for action security_group_members [ 1199.686130] env[69188]: INFO networking_nsxv3.common.synchronization [req-416baa7b-64d2-40e4-949e-437dc4aef7b0 req-c3f943f1-aff3-49cf-9dfa-613bd725931f service nova] Enqueued Resource ID: 0bf18a15-bdc8-4dc8-a0f7-514d44d02d6e with Priority: HIGHEST for action port [ 1199.686321] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 867581e0-cbbd-4108-a823-0b7c53d47c3a with Priority: HIGHEST for action security_group_rules [ 1199.686441] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 867581e0-cbbd-4108-a823-0b7c53d47c3a with Priority: HIGHEST for action security_group_members [ 1199.686534] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0bf18a15-bdc8-4dc8-a0f7-514d44d02d6e with Priority: HIGHEST for action port [ 1199.688827] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-867581e0-cbbd-4108-a823-0b7c53d47c3a taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.688978] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-867581e0-cbbd-4108-a823-0b7c53d47c3a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.689077] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-867581e0-cbbd-4108-a823-0b7c53d47c3a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.689284] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-867581e0-cbbd-4108-a823-0b7c53d47c3a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.689367] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('867581e0-cbbd-4108-a823-0b7c53d47c3a',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1199.690361] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-867581e0-cbbd-4108-a823-0b7c53d47c3a taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.693864] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-867581e0-cbbd-4108-a823-0b7c53d47c3a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.693864] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-0bf18a15-bdc8-4dc8-a0f7-514d44d02d6e taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.693864] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0bf18a15-bdc8-4dc8-a0f7-514d44d02d6e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.693864] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0bf18a15-bdc8-4dc8-a0f7-514d44d02d6e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.693864] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0bf18a15-bdc8-4dc8-a0f7-514d44d02d6e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.693864] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0bf18a15-bdc8-4dc8-a0f7-514d44d02d6e',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1200.193939] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-867581e0-cbbd-4108-a823-0b7c53d47c3a taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.194115] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-867581e0-cbbd-4108-a823-0b7c53d47c3a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.194288] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0bf18a15-bdc8-4dc8-a0f7-514d44d02d6e with status ACTIVE [ 1200.194524] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.194661] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.194746] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.194980] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.195112] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.195312] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.195445] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.195522] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.195671] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.195781] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.195996] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.196126] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.196191] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.196365] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.196454] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.196557] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0bf18a15-bdc8-4dc8-a0f7-514d44d02d6e is going to be updated. [ 1200.215819] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.216078] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.216399] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.216637] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.216783] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.216941] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0bf18a15-bdc8-4dc8-a0f7-514d44d02d6e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.346970] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2a389e0c-0be3-41c9-986c-f4b06040a24d in Status: SUCCESS [ 1200.347214] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2a389e0c-0be3-41c9-986c-f4b06040a24d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.670022] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 867581e0-cbbd-4108-a823-0b7c53d47c3a in Status: IN_PROGRESS for 4s [ 1202.680792] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 867581e0-cbbd-4108-a823-0b7c53d47c3a in Status: SUCCESS [ 1202.681139] env[69188]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 867581e0-cbbd-4108-a823-0b7c53d47c3a deletion is rescheduled due to dependency. [ 1202.681139] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-867581e0-cbbd-4108-a823-0b7c53d47c3a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.681262] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-867581e0-cbbd-4108-a823-0b7c53d47c3a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.681528] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-867581e0-cbbd-4108-a823-0b7c53d47c3a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.681759] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.681873] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.682159] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.682159] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.682249] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.682296] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('867581e0-cbbd-4108-a823-0b7c53d47c3a',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1203.184202] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('867581e0-cbbd-4108-a823-0b7c53d47c3a',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1203.686020] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('867581e0-cbbd-4108-a823-0b7c53d47c3a',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1204.189027] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.189027] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.189027] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.189337] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.189477] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.189635] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 867581e0-cbbd-4108-a823-0b7c53d47c3a is going to be updated. [ 1204.213166] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.213373] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.213373] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.213566] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.213707] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.221401] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 867581e0-cbbd-4108-a823-0b7c53d47c3a in Status: IN_PROGRESS for 2s [ 1204.687586] env[69188]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1204.688125] env[69188]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1206.231640] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 867581e0-cbbd-4108-a823-0b7c53d47c3a in Status: SUCCESS [ 1206.231978] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-867581e0-cbbd-4108-a823-0b7c53d47c3a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.232059] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-867581e0-cbbd-4108-a823-0b7c53d47c3a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.232278] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-867581e0-cbbd-4108-a823-0b7c53d47c3a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.232469] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.232592] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.232689] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.232809] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.232923] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.233091] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-867581e0-cbbd-4108-a823-0b7c53d47c3a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.233091] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('867581e0-cbbd-4108-a823-0b7c53d47c3a',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1206.735427] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('867581e0-cbbd-4108-a823-0b7c53d47c3a',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1207.089290] env[69188]: INFO networking_nsxv3.common.synchronization [req-4df9ba9b-8a60-455a-bcea-fa67d75e1168 req-768f37ba-7b64-4a3f-aeeb-a102cbabed0d tempest-AttachInterfacesTestJSON-1255877948 tempest-AttachInterfacesTestJSON-1255877948-project-member] Enqueued Resource ID: 2a389e0c-0be3-41c9-986c-f4b06040a24d with Priority: HIGHEST for action security_group_members [ 1207.089820] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2a389e0c-0be3-41c9-986c-f4b06040a24d with Priority: HIGHEST for action security_group_members [ 1207.090130] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-2a389e0c-0be3-41c9-986c-f4b06040a24d taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.090257] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2a389e0c-0be3-41c9-986c-f4b06040a24d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.090323] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2a389e0c-0be3-41c9-986c-f4b06040a24d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.090511] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2a389e0c-0be3-41c9-986c-f4b06040a24d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.090660] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.090770] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.090838] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.090987] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.091084] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.091174] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2a389e0c-0be3-41c9-986c-f4b06040a24d',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1207.237265] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 867581e0-cbbd-4108-a823-0b7c53d47c3a: rpc.has_security_group_logging(os_id): False [ 1207.255060] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.255209] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.255297] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.255479] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.255569] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.255819] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.255970] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.255970] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.256146] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.256225] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.256314] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 867581e0-cbbd-4108-a823-0b7c53d47c3a is going to be updated. [ 1207.311225] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.311406] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.311468] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.311682] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.311824] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.323170] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 867581e0-cbbd-4108-a823-0b7c53d47c3a in Status: IN_PROGRESS for 2s [ 1207.381016] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock network-51 taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.381016] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "network-51" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.381016] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "network-51" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.381016] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "network-51" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.381577] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.381920] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.382183] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.382504] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.382793] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.383132] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1207.383377] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] NeedRegenerationException {{(pid=69188) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1207.383613] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] no value, waiting for create lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1207.383847] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] value creation lock acquired {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1207.384093] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1207.384305] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Calling creation function for not-yet-present value {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1207.385039] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1207.423558] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1207.423558] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Cache value generated in 0.039 seconds for key(s): 'zone-id' {{(pid=69188) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1207.423558] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Released creation lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1207.423829] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "network-51" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.424241] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock port-cef57cab-42db-439b-9387-766ea462f929 taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.424458] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "port-cef57cab-42db-439b-9387-766ea462f929" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.424608] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "port-cef57cab-42db-439b-9387-766ea462f929" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.425023] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "port-cef57cab-42db-439b-9387-766ea462f929" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.425203] env[69188]: DEBUG networking_nsxv3.api.rpc [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cef57cab-42db-439b-9387-766ea462f929',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1207.594411] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2a389e0c-0be3-41c9-986c-f4b06040a24d',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1207.928184] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.928411] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.928557] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.928842] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.928999] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.929174] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Segment Port cef57cab-42db-439b-9387-766ea462f929 not found, creating... [ 1207.929439] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.929618] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.929760] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.929990] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.930193] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.930497] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.930677] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.930835] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.931095] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.931244] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.931387] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Resource: SegmentPort with ID: cef57cab-42db-439b-9387-766ea462f929 is going to be created. [ 1207.961483] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.961711] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.961825] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.962100] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.962331] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.962557] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "port-cef57cab-42db-439b-9387-766ea462f929" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.097346] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2a389e0c-0be3-41c9-986c-f4b06040a24d',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1208.599409] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.599799] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.599799] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.599891] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.600074] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.600074] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2a389e0c-0be3-41c9-986c-f4b06040a24d is going to be updated. [ 1208.629546] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.629733] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.629846] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.630088] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.630237] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.640906] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2a389e0c-0be3-41c9-986c-f4b06040a24d in Status: IN_PROGRESS for 2s [ 1208.814823] env[69188]: INFO networking_nsxv3.common.synchronization [req-4df9ba9b-8a60-455a-bcea-fa67d75e1168 req-804e464a-dc76-4dbb-9822-78b8b6d29397 service nova] Enqueued Resource ID: 2a389e0c-0be3-41c9-986c-f4b06040a24d with Priority: HIGHEST for action security_group_rules [ 1208.815038] env[69188]: INFO networking_nsxv3.common.synchronization [req-4df9ba9b-8a60-455a-bcea-fa67d75e1168 req-804e464a-dc76-4dbb-9822-78b8b6d29397 service nova] Enqueued Resource ID: 2a389e0c-0be3-41c9-986c-f4b06040a24d with Priority: HIGHEST for action security_group_members [ 1208.815265] env[69188]: INFO networking_nsxv3.common.synchronization [req-4df9ba9b-8a60-455a-bcea-fa67d75e1168 req-804e464a-dc76-4dbb-9822-78b8b6d29397 service nova] Enqueued Resource ID: cef57cab-42db-439b-9387-766ea462f929 with Priority: HIGHEST for action port [ 1208.815508] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2a389e0c-0be3-41c9-986c-f4b06040a24d with Priority: HIGHEST for action security_group_rules [ 1208.815668] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2a389e0c-0be3-41c9-986c-f4b06040a24d with Priority: HIGHEST for action security_group_members [ 1208.815818] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cef57cab-42db-439b-9387-766ea462f929 with Priority: HIGHEST for action port [ 1208.816609] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2a389e0c-0be3-41c9-986c-f4b06040a24d taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.816722] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2a389e0c-0be3-41c9-986c-f4b06040a24d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.816825] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2a389e0c-0be3-41c9-986c-f4b06040a24d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.817076] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2a389e0c-0be3-41c9-986c-f4b06040a24d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.817187] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2a389e0c-0be3-41c9-986c-f4b06040a24d',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1208.818387] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-2a389e0c-0be3-41c9-986c-f4b06040a24d taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.818519] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2a389e0c-0be3-41c9-986c-f4b06040a24d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.818800] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-cef57cab-42db-439b-9387-766ea462f929 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.818918] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cef57cab-42db-439b-9387-766ea462f929" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.818977] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cef57cab-42db-439b-9387-766ea462f929" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.819183] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cef57cab-42db-439b-9387-766ea462f929" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.819247] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cef57cab-42db-439b-9387-766ea462f929',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1209.321876] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-2a389e0c-0be3-41c9-986c-f4b06040a24d taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.322071] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2a389e0c-0be3-41c9-986c-f4b06040a24d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.322323] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port cef57cab-42db-439b-9387-766ea462f929 with status ACTIVE [ 1209.323071] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.323071] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.323071] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.323286] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.323286] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.323599] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.323599] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.323692] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.323913] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.324056] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.324332] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.324474] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.324570] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.324774] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.324889] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.325029] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: cef57cab-42db-439b-9387-766ea462f929 is going to be updated. [ 1209.339403] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 867581e0-cbbd-4108-a823-0b7c53d47c3a in Status: SUCCESS [ 1209.339649] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-867581e0-cbbd-4108-a823-0b7c53d47c3a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.346709] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.346863] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.346965] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.347204] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.347378] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.347575] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cef57cab-42db-439b-9387-766ea462f929" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.650879] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2a389e0c-0be3-41c9-986c-f4b06040a24d in Status: IN_PROGRESS for 4s [ 1212.299040] env[69188]: INFO networking_nsxv3.common.synchronization [req-290bed5b-ff8f-40fd-bfea-c693e6336718 req-ceacb4f9-a260-44b7-a524-a04b9ed9c541 tempest-ServerActionsTestJSON-1027345226 tempest-ServerActionsTestJSON-1027345226-project-member] Enqueued Resource ID: 9482bec7-7d68-4fe1-8d77-d380c3f6dc7a with Priority: HIGHEST for action security_group_members [ 1212.299593] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9482bec7-7d68-4fe1-8d77-d380c3f6dc7a with Priority: HIGHEST for action security_group_members [ 1212.299898] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-9482bec7-7d68-4fe1-8d77-d380c3f6dc7a taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.300031] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9482bec7-7d68-4fe1-8d77-d380c3f6dc7a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.300098] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9482bec7-7d68-4fe1-8d77-d380c3f6dc7a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.300290] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9482bec7-7d68-4fe1-8d77-d380c3f6dc7a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.300446] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.300543] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.300602] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.300761] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.300853] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.300944] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9482bec7-7d68-4fe1-8d77-d380c3f6dc7a',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1212.662481] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2a389e0c-0be3-41c9-986c-f4b06040a24d in Status: SUCCESS [ 1212.662481] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2a389e0c-0be3-41c9-986c-f4b06040a24d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.662481] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2a389e0c-0be3-41c9-986c-f4b06040a24d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.662674] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2a389e0c-0be3-41c9-986c-f4b06040a24d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.662864] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.662985] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.663064] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.663220] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.663301] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.663411] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2a389e0c-0be3-41c9-986c-f4b06040a24d',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1212.802547] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.802852] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.802852] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.803011] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.803116] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.803311] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.803416] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.803464] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.803647] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.803744] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.803839] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9482bec7-7d68-4fe1-8d77-d380c3f6dc7a is going to be updated. [ 1212.829125] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.829318] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.829318] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.829550] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.829607] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.837049] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9482bec7-7d68-4fe1-8d77-d380c3f6dc7a in Status: IN_PROGRESS for 2s [ 1213.165637] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2a389e0c-0be3-41c9-986c-f4b06040a24d',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1213.669068] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2a389e0c-0be3-41c9-986c-f4b06040a24d',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1214.170845] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.171058] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.171115] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.171380] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.171497] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.171612] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2a389e0c-0be3-41c9-986c-f4b06040a24d is going to be updated. [ 1214.209820] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.210085] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.210195] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.210535] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.210778] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.220482] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2a389e0c-0be3-41c9-986c-f4b06040a24d in Status: IN_PROGRESS for 2s [ 1214.854667] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9482bec7-7d68-4fe1-8d77-d380c3f6dc7a in Status: SUCCESS [ 1214.854948] env[69188]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9482bec7-7d68-4fe1-8d77-d380c3f6dc7a deletion is rescheduled due to dependency. [ 1214.855161] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9482bec7-7d68-4fe1-8d77-d380c3f6dc7a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.230269] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2a389e0c-0be3-41c9-986c-f4b06040a24d in Status: SUCCESS [ 1216.230657] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2a389e0c-0be3-41c9-986c-f4b06040a24d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.230855] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2a389e0c-0be3-41c9-986c-f4b06040a24d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.231212] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2a389e0c-0be3-41c9-986c-f4b06040a24d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.231517] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.231709] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.231857] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.232120] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.232267] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.232423] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2a389e0c-0be3-41c9-986c-f4b06040a24d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.232584] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2a389e0c-0be3-41c9-986c-f4b06040a24d',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1216.735436] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2a389e0c-0be3-41c9-986c-f4b06040a24d',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1217.237762] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2a389e0c-0be3-41c9-986c-f4b06040a24d: rpc.has_security_group_logging(os_id): False [ 1217.255355] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.255537] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.255537] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.255776] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.255894] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.256086] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.256258] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.256258] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.256459] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.256459] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.256623] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2a389e0c-0be3-41c9-986c-f4b06040a24d is going to be updated. [ 1217.300480] env[69188]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1217.300575] env[69188]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1217.320390] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.320545] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.320594] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.320772] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.320911] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.334013] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2a389e0c-0be3-41c9-986c-f4b06040a24d in Status: IN_PROGRESS for 2s [ 1217.825878] env[69188]: INFO networking_nsxv3.common.synchronization [None req-32bf2d8c-82ec-44cb-9738-420df02cfa47 tempest-AttachInterfacesTestJSON-1255877948 tempest-AttachInterfacesTestJSON-1255877948-project-member] Enqueued Resource ID: 12570d95-0a4a-4579-82c8-53ecf65f714e with Priority: HIGHEST for action security_group_members [ 1217.827031] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 12570d95-0a4a-4579-82c8-53ecf65f714e with Priority: HIGHEST for action security_group_members [ 1217.827031] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-12570d95-0a4a-4579-82c8-53ecf65f714e taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.827031] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-12570d95-0a4a-4579-82c8-53ecf65f714e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.827232] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-12570d95-0a4a-4579-82c8-53ecf65f714e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.827318] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-12570d95-0a4a-4579-82c8-53ecf65f714e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.827391] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.827472] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.827523] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.827664] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.827746] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.827836] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('12570d95-0a4a-4579-82c8-53ecf65f714e',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1218.330217] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.330543] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.330595] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.330914] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.331109] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.331414] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.331581] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.331697] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.331987] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.332135] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.332299] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 12570d95-0a4a-4579-82c8-53ecf65f714e is going to be updated. [ 1218.355982] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.356136] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.356227] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.356455] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.356635] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.367106] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 12570d95-0a4a-4579-82c8-53ecf65f714e in Status: IN_PROGRESS for 2s [ 1219.303249] env[69188]: INFO networking_nsxv3.common.synchronization [req-5f4f684a-96cb-4198-a94c-7241caf09142 req-3cf33d36-fb99-4f7a-82b9-9dd822fcd4c3 tempest-AttachVolumeShelveTestJSON-383073810 tempest-AttachVolumeShelveTestJSON-383073810-project-member] Enqueued Resource ID: 4c598260-71fe-43f5-ab89-63a95724ea23 with Priority: HIGHEST for action security_group_members [ 1219.307429] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4c598260-71fe-43f5-ab89-63a95724ea23 with Priority: HIGHEST for action security_group_members [ 1219.308366] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-4c598260-71fe-43f5-ab89-63a95724ea23 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.308565] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4c598260-71fe-43f5-ab89-63a95724ea23" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.308669] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4c598260-71fe-43f5-ab89-63a95724ea23" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.308980] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4c598260-71fe-43f5-ab89-63a95724ea23" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.309239] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.309396] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.309494] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.309717] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.309849] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.309992] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4c598260-71fe-43f5-ab89-63a95724ea23',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1219.350313] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2a389e0c-0be3-41c9-986c-f4b06040a24d in Status: SUCCESS [ 1219.350806] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2a389e0c-0be3-41c9-986c-f4b06040a24d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.529679] env[69188]: INFO networking_nsxv3.common.synchronization [req-52da0702-4591-48e8-83e3-32874cc20892 req-266a4939-28da-4680-83f8-0b2563110ca6 tempest-ServerActionsTestJSON-1027345226 tempest-ServerActionsTestJSON-1027345226-project-member] Enqueued Resource ID: 9482bec7-7d68-4fe1-8d77-d380c3f6dc7a with Priority: HIGHEST for action security_group_members [ 1219.530835] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9482bec7-7d68-4fe1-8d77-d380c3f6dc7a with Priority: HIGHEST for action security_group_members [ 1219.531217] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-9482bec7-7d68-4fe1-8d77-d380c3f6dc7a taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.531395] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9482bec7-7d68-4fe1-8d77-d380c3f6dc7a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.531501] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9482bec7-7d68-4fe1-8d77-d380c3f6dc7a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.531848] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9482bec7-7d68-4fe1-8d77-d380c3f6dc7a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.532091] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.532343] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.532447] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.532679] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.532809] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.532979] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9482bec7-7d68-4fe1-8d77-d380c3f6dc7a',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1219.812413] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.812663] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.812663] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.812857] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.812980] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.813152] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.813254] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.813317] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.813462] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.813573] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.813615] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4c598260-71fe-43f5-ab89-63a95724ea23 is going to be updated. [ 1219.819379] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock network-859 taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.819575] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "network-859" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.819706] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "network-859" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.819954] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "network-859" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.820228] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.820388] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.820517] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.820727] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.820871] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.821094] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1219.821211] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] NeedRegenerationException {{(pid=69188) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1219.821319] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] no value, waiting for create lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1219.821428] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] value creation lock acquired {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1219.821536] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1219.821641] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Calling creation function for not-yet-present value {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1219.821775] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1219.839234] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1219.839400] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69188) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1219.839539] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Released creation lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1219.839735] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "network-859" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.840050] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock port-9abd2530-53ec-4301-845e-e3e5c78c5c38 taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.840229] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "port-9abd2530-53ec-4301-845e-e3e5c78c5c38" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.840355] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "port-9abd2530-53ec-4301-845e-e3e5c78c5c38" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.840703] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "port-9abd2530-53ec-4301-845e-e3e5c78c5c38" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.840848] env[69188]: DEBUG networking_nsxv3.api.rpc [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9abd2530-53ec-4301-845e-e3e5c78c5c38',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1219.842991] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.843126] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.843188] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.843369] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.843528] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.851573] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4c598260-71fe-43f5-ab89-63a95724ea23 in Status: IN_PROGRESS for 2s [ 1220.034928] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.035101] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.035174] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.035399] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.035497] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.035692] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.035790] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.035854] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.036032] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.036251] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.036251] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9482bec7-7d68-4fe1-8d77-d380c3f6dc7a is going to be updated. [ 1220.058323] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.058461] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.058534] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.058737] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.058902] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.067570] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9482bec7-7d68-4fe1-8d77-d380c3f6dc7a in Status: IN_PROGRESS for 2s [ 1220.346031] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.346031] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.346031] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.346396] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.346494] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.346651] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Segment Port 9abd2530-53ec-4301-845e-e3e5c78c5c38 not found, creating... [ 1220.346936] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.347110] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.347275] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.347512] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.347661] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.347956] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.348136] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.348260] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.348504] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.348650] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.348791] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Resource: SegmentPort with ID: 9abd2530-53ec-4301-845e-e3e5c78c5c38 is going to be created. [ 1220.369125] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.369436] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.369480] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.369706] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.369937] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.370173] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "port-9abd2530-53ec-4301-845e-e3e5c78c5c38" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.378672] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 12570d95-0a4a-4579-82c8-53ecf65f714e in Status: SUCCESS [ 1220.378890] env[69188]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 12570d95-0a4a-4579-82c8-53ecf65f714e deletion is rescheduled due to dependency. [ 1220.379043] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-12570d95-0a4a-4579-82c8-53ecf65f714e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.034236] env[69188]: INFO networking_nsxv3.common.synchronization [req-52da0702-4591-48e8-83e3-32874cc20892 req-f31e5318-aa15-48b3-b621-3f30ca456aef service nova] Enqueued Resource ID: 9482bec7-7d68-4fe1-8d77-d380c3f6dc7a with Priority: HIGHEST for action security_group_rules [ 1221.034428] env[69188]: INFO networking_nsxv3.common.synchronization [req-52da0702-4591-48e8-83e3-32874cc20892 req-f31e5318-aa15-48b3-b621-3f30ca456aef service nova] Enqueued Resource ID: 9482bec7-7d68-4fe1-8d77-d380c3f6dc7a with Priority: HIGHEST for action security_group_members [ 1221.034572] env[69188]: INFO networking_nsxv3.common.synchronization [req-52da0702-4591-48e8-83e3-32874cc20892 req-f31e5318-aa15-48b3-b621-3f30ca456aef service nova] Enqueued Resource ID: 9abd2530-53ec-4301-845e-e3e5c78c5c38 with Priority: HIGHEST for action port [ 1221.034827] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9482bec7-7d68-4fe1-8d77-d380c3f6dc7a with Priority: HIGHEST for action security_group_rules [ 1221.034969] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9482bec7-7d68-4fe1-8d77-d380c3f6dc7a with Priority: HIGHEST for action security_group_members [ 1221.035123] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9abd2530-53ec-4301-845e-e3e5c78c5c38 with Priority: HIGHEST for action port [ 1221.035667] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9482bec7-7d68-4fe1-8d77-d380c3f6dc7a taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.036322] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9482bec7-7d68-4fe1-8d77-d380c3f6dc7a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.036420] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9482bec7-7d68-4fe1-8d77-d380c3f6dc7a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.037737] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9482bec7-7d68-4fe1-8d77-d380c3f6dc7a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.037737] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9482bec7-7d68-4fe1-8d77-d380c3f6dc7a',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1221.037737] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-9482bec7-7d68-4fe1-8d77-d380c3f6dc7a taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.037737] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9482bec7-7d68-4fe1-8d77-d380c3f6dc7a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.037996] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-9abd2530-53ec-4301-845e-e3e5c78c5c38 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.037996] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9abd2530-53ec-4301-845e-e3e5c78c5c38" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.038140] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9abd2530-53ec-4301-845e-e3e5c78c5c38" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.038230] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9abd2530-53ec-4301-845e-e3e5c78c5c38" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.038279] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9abd2530-53ec-4301-845e-e3e5c78c5c38',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1221.540236] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-9482bec7-7d68-4fe1-8d77-d380c3f6dc7a taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.540236] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9482bec7-7d68-4fe1-8d77-d380c3f6dc7a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.540544] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9abd2530-53ec-4301-845e-e3e5c78c5c38 with status ACTIVE [ 1221.540544] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.540651] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.540690] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.540870] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.540961] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.541497] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.541497] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.541497] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.542259] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.542374] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.542563] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.542679] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.542746] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.542930] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.543051] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.543141] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9abd2530-53ec-4301-845e-e3e5c78c5c38 is going to be updated. [ 1221.566325] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.566470] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.566527] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.566701] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.566832] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.566987] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9abd2530-53ec-4301-845e-e3e5c78c5c38" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.860701] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4c598260-71fe-43f5-ab89-63a95724ea23 in Status: SUCCESS [ 1221.860874] env[69188]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4c598260-71fe-43f5-ab89-63a95724ea23 deletion is rescheduled due to dependency. [ 1221.860947] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4c598260-71fe-43f5-ab89-63a95724ea23" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.077251] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9482bec7-7d68-4fe1-8d77-d380c3f6dc7a in Status: SUCCESS [ 1222.077346] env[69188]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9482bec7-7d68-4fe1-8d77-d380c3f6dc7a deletion is rescheduled due to dependency. [ 1222.077458] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9482bec7-7d68-4fe1-8d77-d380c3f6dc7a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.077604] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9482bec7-7d68-4fe1-8d77-d380c3f6dc7a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.077810] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9482bec7-7d68-4fe1-8d77-d380c3f6dc7a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.077992] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.078119] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.078185] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.078336] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.078417] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.078512] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9482bec7-7d68-4fe1-8d77-d380c3f6dc7a',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1222.580719] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9482bec7-7d68-4fe1-8d77-d380c3f6dc7a',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1223.082826] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9482bec7-7d68-4fe1-8d77-d380c3f6dc7a',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1223.587050] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.587050] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.587050] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.587459] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.587459] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.587534] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9482bec7-7d68-4fe1-8d77-d380c3f6dc7a is going to be updated. [ 1223.613411] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.613612] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.613675] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.613932] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.614137] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.624123] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9482bec7-7d68-4fe1-8d77-d380c3f6dc7a in Status: IN_PROGRESS for 2s [ 1223.998557] env[69188]: INFO networking_nsxv3.common.synchronization [None req-af517119-2287-43e5-8973-72d85bb8f1c5 tempest-AttachVolumeShelveTestJSON-383073810 tempest-AttachVolumeShelveTestJSON-383073810-project-member] Enqueued Resource ID: f85bb0c6-bf80-4499-b5c3-0b4c4169bdc0 with Priority: HIGHEST for action security_group_rules [ 1223.999111] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f85bb0c6-bf80-4499-b5c3-0b4c4169bdc0 with Priority: HIGHEST for action security_group_rules [ 1223.999433] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f85bb0c6-bf80-4499-b5c3-0b4c4169bdc0 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.999552] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f85bb0c6-bf80-4499-b5c3-0b4c4169bdc0" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.999616] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f85bb0c6-bf80-4499-b5c3-0b4c4169bdc0" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.999885] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f85bb0c6-bf80-4499-b5c3-0b4c4169bdc0" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.999961] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f85bb0c6-bf80-4499-b5c3-0b4c4169bdc0',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1224.065400] env[69188]: INFO networking_nsxv3.common.synchronization [None req-7cdad582-aa80-4651-a6b9-d062cc84fa14 tempest-AttachVolumeShelveTestJSON-383073810 tempest-AttachVolumeShelveTestJSON-383073810-project-member] Enqueued Resource ID: f85bb0c6-bf80-4499-b5c3-0b4c4169bdc0 with Priority: HIGHEST for action security_group_rules [ 1224.065884] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f85bb0c6-bf80-4499-b5c3-0b4c4169bdc0 with Priority: HIGHEST for action security_group_rules [ 1224.066194] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f85bb0c6-bf80-4499-b5c3-0b4c4169bdc0 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.066293] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f85bb0c6-bf80-4499-b5c3-0b4c4169bdc0" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.519045] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.519205] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.519275] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.519488] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.519580] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.519675] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f85bb0c6-bf80-4499-b5c3-0b4c4169bdc0 already deleted. [ 1224.519756] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f85bb0c6-bf80-4499-b5c3-0b4c4169bdc0" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.519904] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f85bb0c6-bf80-4499-b5c3-0b4c4169bdc0" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.520067] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f85bb0c6-bf80-4499-b5c3-0b4c4169bdc0" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.520150] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f85bb0c6-bf80-4499-b5c3-0b4c4169bdc0',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1225.038616] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.039038] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.039038] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.039148] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.039230] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.039351] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f85bb0c6-bf80-4499-b5c3-0b4c4169bdc0 already deleted. [ 1225.039473] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f85bb0c6-bf80-4499-b5c3-0b4c4169bdc0" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.633734] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9482bec7-7d68-4fe1-8d77-d380c3f6dc7a in Status: SUCCESS [ 1225.633941] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9482bec7-7d68-4fe1-8d77-d380c3f6dc7a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.634083] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9482bec7-7d68-4fe1-8d77-d380c3f6dc7a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.634507] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9482bec7-7d68-4fe1-8d77-d380c3f6dc7a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.634749] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.634872] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.634940] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.635128] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.635213] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.635301] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9482bec7-7d68-4fe1-8d77-d380c3f6dc7a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.635392] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9482bec7-7d68-4fe1-8d77-d380c3f6dc7a',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1226.138157] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9482bec7-7d68-4fe1-8d77-d380c3f6dc7a',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1226.640856] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9482bec7-7d68-4fe1-8d77-d380c3f6dc7a: rpc.has_security_group_logging(os_id): False [ 1226.656796] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.656995] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.656995] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.657232] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.657326] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.657575] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.657671] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.657733] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.657882] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.657958] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.658058] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9482bec7-7d68-4fe1-8d77-d380c3f6dc7a is going to be updated. [ 1226.710420] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.710590] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.710590] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.710744] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.710859] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.722941] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9482bec7-7d68-4fe1-8d77-d380c3f6dc7a in Status: IN_PROGRESS for 2s [ 1228.737107] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9482bec7-7d68-4fe1-8d77-d380c3f6dc7a in Status: SUCCESS [ 1228.737473] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9482bec7-7d68-4fe1-8d77-d380c3f6dc7a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1229.067206] env[69188]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1229.067320] env[69188]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1229.378809] env[69188]: INFO networking_nsxv3.common.synchronization [req-a93992d6-9c51-4f33-8993-97a77408bd08 req-1411a4fa-6c3c-4531-be5a-ed9d2595ec60 tempest-AttachVolumeShelveTestJSON-383073810 tempest-AttachVolumeShelveTestJSON-383073810-project-member] Enqueued Resource ID: f85bb0c6-bf80-4499-b5c3-0b4c4169bdc0 with Priority: HIGHEST for action security_group_members [ 1229.379328] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f85bb0c6-bf80-4499-b5c3-0b4c4169bdc0 with Priority: HIGHEST for action security_group_members [ 1229.379634] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-f85bb0c6-bf80-4499-b5c3-0b4c4169bdc0 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.379758] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f85bb0c6-bf80-4499-b5c3-0b4c4169bdc0" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1229.379823] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f85bb0c6-bf80-4499-b5c3-0b4c4169bdc0" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1229.380388] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f85bb0c6-bf80-4499-b5c3-0b4c4169bdc0" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1229.380612] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.380723] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1229.380788] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1229.380967] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1229.381078] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1229.381170] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f85bb0c6-bf80-4499-b5c3-0b4c4169bdc0',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1229.630011] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock network-796 taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.630230] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "network-796" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1229.630361] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "network-796" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1229.630639] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "network-796" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1229.630898] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.631070] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1229.631196] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1229.631424] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1229.631580] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1229.631796] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1229.631911] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] NeedRegenerationException {{(pid=69188) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1229.632094] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] no value, waiting for create lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1229.632208] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] value creation lock acquired {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1229.632321] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1229.632429] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Calling creation function for not-yet-present value {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1229.632563] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1229.650094] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1229.650257] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69188) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1229.650399] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Released creation lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1229.650572] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "network-796" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1229.650863] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock port-8d37fbe0-fdbc-4008-8c42-ec7afee8b2e6 taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.651069] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "port-8d37fbe0-fdbc-4008-8c42-ec7afee8b2e6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1229.651170] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "port-8d37fbe0-fdbc-4008-8c42-ec7afee8b2e6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1229.651463] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "port-8d37fbe0-fdbc-4008-8c42-ec7afee8b2e6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1229.651611] env[69188]: DEBUG networking_nsxv3.api.rpc [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8d37fbe0-fdbc-4008-8c42-ec7afee8b2e6',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1229.883590] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.884666] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1229.884666] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1229.884666] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1229.884666] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1229.884666] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.884666] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1229.884666] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1229.884666] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1229.885219] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1229.885219] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f85bb0c6-bf80-4499-b5c3-0b4c4169bdc0 already deleted. [ 1229.885219] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f85bb0c6-bf80-4499-b5c3-0b4c4169bdc0" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.153485] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.153706] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.153836] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.154121] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.154302] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.154440] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Segment Port 8d37fbe0-fdbc-4008-8c42-ec7afee8b2e6 not found, creating... [ 1230.154696] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.154865] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.154968] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.155195] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.155335] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.155614] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.156230] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.156230] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.156230] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.156415] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.156415] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Resource: SegmentPort with ID: 8d37fbe0-fdbc-4008-8c42-ec7afee8b2e6 is going to be created. [ 1230.175040] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.175267] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.175401] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.175686] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.175917] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.176183] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "port-8d37fbe0-fdbc-4008-8c42-ec7afee8b2e6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.875136] env[69188]: INFO networking_nsxv3.common.synchronization [req-a93992d6-9c51-4f33-8993-97a77408bd08 req-eea9b039-320c-4f29-94f5-03b0c206ba9e service nova] Enqueued Resource ID: f85bb0c6-bf80-4499-b5c3-0b4c4169bdc0 with Priority: HIGHEST for action security_group_rules [ 1230.875312] env[69188]: INFO networking_nsxv3.common.synchronization [req-a93992d6-9c51-4f33-8993-97a77408bd08 req-eea9b039-320c-4f29-94f5-03b0c206ba9e service nova] Enqueued Resource ID: f85bb0c6-bf80-4499-b5c3-0b4c4169bdc0 with Priority: HIGHEST for action security_group_members [ 1230.875474] env[69188]: INFO networking_nsxv3.common.synchronization [req-a93992d6-9c51-4f33-8993-97a77408bd08 req-eea9b039-320c-4f29-94f5-03b0c206ba9e service nova] Enqueued Resource ID: 8d37fbe0-fdbc-4008-8c42-ec7afee8b2e6 with Priority: HIGHEST for action port [ 1230.875706] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f85bb0c6-bf80-4499-b5c3-0b4c4169bdc0 with Priority: HIGHEST for action security_group_rules [ 1230.875830] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f85bb0c6-bf80-4499-b5c3-0b4c4169bdc0 with Priority: HIGHEST for action security_group_members [ 1230.875923] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8d37fbe0-fdbc-4008-8c42-ec7afee8b2e6 with Priority: HIGHEST for action port [ 1230.876607] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f85bb0c6-bf80-4499-b5c3-0b4c4169bdc0 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.876607] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f85bb0c6-bf80-4499-b5c3-0b4c4169bdc0" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.876745] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f85bb0c6-bf80-4499-b5c3-0b4c4169bdc0" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.876872] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f85bb0c6-bf80-4499-b5c3-0b4c4169bdc0" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.876949] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f85bb0c6-bf80-4499-b5c3-0b4c4169bdc0',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1230.877755] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-f85bb0c6-bf80-4499-b5c3-0b4c4169bdc0 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.877863] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f85bb0c6-bf80-4499-b5c3-0b4c4169bdc0" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.877932] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f85bb0c6-bf80-4499-b5c3-0b4c4169bdc0" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.878167] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f85bb0c6-bf80-4499-b5c3-0b4c4169bdc0" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.878259] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.878370] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.878433] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.878579] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.878661] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.878745] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f85bb0c6-bf80-4499-b5c3-0b4c4169bdc0',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1230.879724] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-8d37fbe0-fdbc-4008-8c42-ec7afee8b2e6 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.879826] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8d37fbe0-fdbc-4008-8c42-ec7afee8b2e6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.879911] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8d37fbe0-fdbc-4008-8c42-ec7afee8b2e6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.880102] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8d37fbe0-fdbc-4008-8c42-ec7afee8b2e6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.880178] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8d37fbe0-fdbc-4008-8c42-ec7afee8b2e6',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1231.382918] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-f85bb0c6-bf80-4499-b5c3-0b4c4169bdc0 taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.383273] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f85bb0c6-bf80-4499-b5c3-0b4c4169bdc0" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.383455] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f85bb0c6-bf80-4499-b5c3-0b4c4169bdc0',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1231.384690] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8d37fbe0-fdbc-4008-8c42-ec7afee8b2e6 with status ACTIVE [ 1231.384881] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.384989] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.385094] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.385299] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.385384] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.385555] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.385646] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.385703] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.385841] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.385914] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.386108] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.386203] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.386252] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.386383] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.386454] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.386537] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8d37fbe0-fdbc-4008-8c42-ec7afee8b2e6 is going to be updated. [ 1231.405701] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.405868] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.405905] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.406443] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.406443] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.406443] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8d37fbe0-fdbc-4008-8c42-ec7afee8b2e6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.888834] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f85bb0c6-bf80-4499-b5c3-0b4c4169bdc0',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1232.391419] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.391676] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.391676] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.391871] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.391986] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.392108] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f85bb0c6-bf80-4499-b5c3-0b4c4169bdc0 is going to be created. [ 1232.415190] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.415340] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.415387] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.415573] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.415721] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.424152] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f85bb0c6-bf80-4499-b5c3-0b4c4169bdc0 in Status: UNINITIALIZED for 2s [ 1234.305196] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock network-51 taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.305508] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "network-51" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.305508] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "network-51" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.306178] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "network-51" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.306457] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.306622] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.306747] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.306966] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.307133] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.307344] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1234.307462] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] NeedRegenerationException {{(pid=69188) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1234.307575] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] no value, waiting for create lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1234.307686] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] value creation lock acquired {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1234.307797] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1234.307905] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Calling creation function for not-yet-present value {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1234.308051] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1234.325415] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1234.325571] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69188) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1234.325712] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Released creation lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1234.325878] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "network-51" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.326176] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock port-3624157c-89e9-4dd3-bd28-b281d14a42da taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.326341] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "port-3624157c-89e9-4dd3-bd28-b281d14a42da" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.326463] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "port-3624157c-89e9-4dd3-bd28-b281d14a42da" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.326752] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "port-3624157c-89e9-4dd3-bd28-b281d14a42da" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.326893] env[69188]: DEBUG networking_nsxv3.api.rpc [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3624157c-89e9-4dd3-bd28-b281d14a42da',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1234.432430] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f85bb0c6-bf80-4499-b5c3-0b4c4169bdc0 in Status: SUCCESS [ 1234.432640] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f85bb0c6-bf80-4499-b5c3-0b4c4169bdc0" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.432789] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f85bb0c6-bf80-4499-b5c3-0b4c4169bdc0" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.433009] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f85bb0c6-bf80-4499-b5c3-0b4c4169bdc0" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.433236] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.433352] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.433416] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.433570] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.433653] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.433738] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f85bb0c6-bf80-4499-b5c3-0b4c4169bdc0" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.433828] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f85bb0c6-bf80-4499-b5c3-0b4c4169bdc0',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1234.829543] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.829761] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.829841] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.830193] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.830365] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.830526] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Segment Port 3624157c-89e9-4dd3-bd28-b281d14a42da not found, creating... [ 1234.830791] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.830951] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.831086] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.831330] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.831475] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.831771] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.831913] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.832067] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.832296] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.832441] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.832580] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Resource: SegmentPort with ID: 3624157c-89e9-4dd3-bd28-b281d14a42da is going to be created. [ 1234.853771] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.853968] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.854102] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.854358] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.854578] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.854804] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "port-3624157c-89e9-4dd3-bd28-b281d14a42da" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.935505] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f85bb0c6-bf80-4499-b5c3-0b4c4169bdc0',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1235.438257] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f85bb0c6-bf80-4499-b5c3-0b4c4169bdc0: rpc.has_security_group_logging(os_id): False [ 1235.455632] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.455798] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.455948] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.456137] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.456283] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.460221] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.460369] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.460443] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.460665] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.460782] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.460833] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f85bb0c6-bf80-4499-b5c3-0b4c4169bdc0 is going to be created. [ 1235.517013] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.517241] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.517241] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.517454] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.517633] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.530648] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f85bb0c6-bf80-4499-b5c3-0b4c4169bdc0 in Status: IN_PROGRESS for 2s [ 1235.553776] env[69188]: INFO networking_nsxv3.common.synchronization [req-f86fc915-5d06-42de-b717-46a3e271abcc req-d6835d53-a48e-4697-85b6-16ec58fd1e48 service nova] Enqueued Resource ID: 12570d95-0a4a-4579-82c8-53ecf65f714e with Priority: HIGHEST for action security_group_rules [ 1235.553991] env[69188]: INFO networking_nsxv3.common.synchronization [req-f86fc915-5d06-42de-b717-46a3e271abcc req-d6835d53-a48e-4697-85b6-16ec58fd1e48 service nova] Enqueued Resource ID: 12570d95-0a4a-4579-82c8-53ecf65f714e with Priority: HIGHEST for action security_group_members [ 1235.554194] env[69188]: INFO networking_nsxv3.common.synchronization [req-f86fc915-5d06-42de-b717-46a3e271abcc req-d6835d53-a48e-4697-85b6-16ec58fd1e48 service nova] Enqueued Resource ID: 3624157c-89e9-4dd3-bd28-b281d14a42da with Priority: HIGHEST for action port [ 1235.554861] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 12570d95-0a4a-4579-82c8-53ecf65f714e with Priority: HIGHEST for action security_group_rules [ 1235.555114] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 12570d95-0a4a-4579-82c8-53ecf65f714e with Priority: HIGHEST for action security_group_members [ 1235.555302] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3624157c-89e9-4dd3-bd28-b281d14a42da with Priority: HIGHEST for action port [ 1235.555673] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-12570d95-0a4a-4579-82c8-53ecf65f714e taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.555842] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-12570d95-0a4a-4579-82c8-53ecf65f714e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.555957] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-12570d95-0a4a-4579-82c8-53ecf65f714e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.556654] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-12570d95-0a4a-4579-82c8-53ecf65f714e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.556654] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('12570d95-0a4a-4579-82c8-53ecf65f714e',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1235.557427] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-12570d95-0a4a-4579-82c8-53ecf65f714e taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.557573] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-12570d95-0a4a-4579-82c8-53ecf65f714e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.557664] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-12570d95-0a4a-4579-82c8-53ecf65f714e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.557910] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-12570d95-0a4a-4579-82c8-53ecf65f714e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.558118] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.558690] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.558807] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.559035] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.559203] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.559374] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('12570d95-0a4a-4579-82c8-53ecf65f714e',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1235.560282] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-3624157c-89e9-4dd3-bd28-b281d14a42da taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.560432] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3624157c-89e9-4dd3-bd28-b281d14a42da" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.560596] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3624157c-89e9-4dd3-bd28-b281d14a42da" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.561031] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3624157c-89e9-4dd3-bd28-b281d14a42da" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.561031] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3624157c-89e9-4dd3-bd28-b281d14a42da',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1236.062362] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('12570d95-0a4a-4579-82c8-53ecf65f714e',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1236.063459] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-12570d95-0a4a-4579-82c8-53ecf65f714e taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.063524] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-12570d95-0a4a-4579-82c8-53ecf65f714e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.063874] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3624157c-89e9-4dd3-bd28-b281d14a42da with status ACTIVE [ 1236.064051] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.064164] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.064230] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.064435] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.064521] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.064697] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.064782] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.064841] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.064982] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.065071] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.065288] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.065363] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.065443] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.065559] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.065630] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.065710] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3624157c-89e9-4dd3-bd28-b281d14a42da is going to be updated. [ 1236.085633] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.085797] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.085797] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.085970] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.086105] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.086257] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3624157c-89e9-4dd3-bd28-b281d14a42da" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.564422] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('12570d95-0a4a-4579-82c8-53ecf65f714e',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1237.066672] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.066815] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.066883] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.067133] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.067227] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.067328] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 12570d95-0a4a-4579-82c8-53ecf65f714e is going to be updated. [ 1237.095766] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.095916] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.095957] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.096134] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.096327] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.103387] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 12570d95-0a4a-4579-82c8-53ecf65f714e in Status: IN_PROGRESS for 2s [ 1237.541547] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f85bb0c6-bf80-4499-b5c3-0b4c4169bdc0 in Status: SUCCESS [ 1237.541784] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f85bb0c6-bf80-4499-b5c3-0b4c4169bdc0" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.112462] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 12570d95-0a4a-4579-82c8-53ecf65f714e in Status: SUCCESS [ 1239.112747] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-12570d95-0a4a-4579-82c8-53ecf65f714e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.112801] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-12570d95-0a4a-4579-82c8-53ecf65f714e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.113011] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-12570d95-0a4a-4579-82c8-53ecf65f714e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.113290] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.113413] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.113481] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.113634] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.113713] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.113798] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-12570d95-0a4a-4579-82c8-53ecf65f714e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.113887] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('12570d95-0a4a-4579-82c8-53ecf65f714e',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1239.616948] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-12570d95-0a4a-4579-82c8-53ecf65f714e taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.617170] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-12570d95-0a4a-4579-82c8-53ecf65f714e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.617292] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-12570d95-0a4a-4579-82c8-53ecf65f714e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.617813] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-12570d95-0a4a-4579-82c8-53ecf65f714e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.618019] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.618128] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.618188] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.618350] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.618457] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.618508] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-12570d95-0a4a-4579-82c8-53ecf65f714e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.618654] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-12570d95-0a4a-4579-82c8-53ecf65f714e taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.618745] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-12570d95-0a4a-4579-82c8-53ecf65f714e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.618800] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-12570d95-0a4a-4579-82c8-53ecf65f714e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.618935] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-12570d95-0a4a-4579-82c8-53ecf65f714e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.619082] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.619192] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.619258] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.619399] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.619477] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.619557] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-12570d95-0a4a-4579-82c8-53ecf65f714e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.619645] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('12570d95-0a4a-4579-82c8-53ecf65f714e',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1240.122273] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 12570d95-0a4a-4579-82c8-53ecf65f714e: rpc.has_security_group_logging(os_id): False [ 1240.139031] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.139178] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.139250] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.139456] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.139546] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.139773] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.139925] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.139988] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.140197] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.140278] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.140513] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.140633] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.140698] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.140851] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.140954] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.141217] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.141364] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.141450] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.141630] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.141712] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.142082] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 12570d95-0a4a-4579-82c8-53ecf65f714e is going to be updated. [ 1240.203256] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.203504] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.203573] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.203773] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.203970] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.219529] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 12570d95-0a4a-4579-82c8-53ecf65f714e in Status: IN_PROGRESS for 2s [ 1240.556339] env[69188]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1240.556574] env[69188]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1242.235511] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 12570d95-0a4a-4579-82c8-53ecf65f714e in Status: SUCCESS [ 1242.235841] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-12570d95-0a4a-4579-82c8-53ecf65f714e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.558095] env[69188]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1245.558509] env[69188]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1250.559488] env[69188]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1250.559488] env[69188]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1250.966879] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock network-51 taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.967102] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "network-51" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.967233] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "network-51" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.967554] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "network-51" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.967830] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.967990] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.968119] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.968336] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.968487] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.968696] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1250.968811] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] NeedRegenerationException {{(pid=69188) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1250.968922] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] no value, waiting for create lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1250.969042] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] value creation lock acquired {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1250.969155] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1250.969262] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Calling creation function for not-yet-present value {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1250.969397] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1250.988360] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1250.988543] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69188) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1250.988658] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Released creation lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1250.988831] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "network-51" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.989152] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock port-3624157c-89e9-4dd3-bd28-b281d14a42da taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.989320] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "port-3624157c-89e9-4dd3-bd28-b281d14a42da" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.989468] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "port-3624157c-89e9-4dd3-bd28-b281d14a42da" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.989773] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "port-3624157c-89e9-4dd3-bd28-b281d14a42da" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.989919] env[69188]: DEBUG networking_nsxv3.api.rpc [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3624157c-89e9-4dd3-bd28-b281d14a42da',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1251.492469] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.492667] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.492782] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.493083] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.493280] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.493592] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.493755] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.493877] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.494120] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.494724] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.494724] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.494724] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.494952] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.494988] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.495171] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.495331] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Resource: SegmentPort with ID: 3624157c-89e9-4dd3-bd28-b281d14a42da is going to be updated. [ 1251.514135] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.514327] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.514458] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.514678] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.514864] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.515089] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "port-3624157c-89e9-4dd3-bd28-b281d14a42da" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.205460] env[69188]: INFO networking_nsxv3.common.synchronization [req-da001178-e282-4735-b710-ab15af2708c7 req-632be1fa-d485-4251-8ca3-9ee9aaa9d4be service nova] Enqueued Resource ID: 12570d95-0a4a-4579-82c8-53ecf65f714e with Priority: HIGHEST for action security_group_rules [ 1252.205711] env[69188]: INFO networking_nsxv3.common.synchronization [req-da001178-e282-4735-b710-ab15af2708c7 req-632be1fa-d485-4251-8ca3-9ee9aaa9d4be service nova] Enqueued Resource ID: 12570d95-0a4a-4579-82c8-53ecf65f714e with Priority: HIGHEST for action security_group_members [ 1252.205942] env[69188]: INFO networking_nsxv3.common.synchronization [req-da001178-e282-4735-b710-ab15af2708c7 req-632be1fa-d485-4251-8ca3-9ee9aaa9d4be service nova] Enqueued Resource ID: 3624157c-89e9-4dd3-bd28-b281d14a42da with Priority: HIGHEST for action port [ 1252.206090] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 12570d95-0a4a-4579-82c8-53ecf65f714e with Priority: HIGHEST for action security_group_rules [ 1252.206224] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 12570d95-0a4a-4579-82c8-53ecf65f714e with Priority: HIGHEST for action security_group_members [ 1252.206328] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3624157c-89e9-4dd3-bd28-b281d14a42da with Priority: HIGHEST for action port [ 1252.206807] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-12570d95-0a4a-4579-82c8-53ecf65f714e taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.206935] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-12570d95-0a4a-4579-82c8-53ecf65f714e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.207014] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-12570d95-0a4a-4579-82c8-53ecf65f714e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.207402] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-12570d95-0a4a-4579-82c8-53ecf65f714e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.207560] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('12570d95-0a4a-4579-82c8-53ecf65f714e',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1252.209383] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-12570d95-0a4a-4579-82c8-53ecf65f714e taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.209509] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-12570d95-0a4a-4579-82c8-53ecf65f714e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.209578] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-12570d95-0a4a-4579-82c8-53ecf65f714e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.209756] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-12570d95-0a4a-4579-82c8-53ecf65f714e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.209907] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.210013] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.210071] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.210224] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.210311] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.210401] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('12570d95-0a4a-4579-82c8-53ecf65f714e',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1252.211650] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-3624157c-89e9-4dd3-bd28-b281d14a42da taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.211760] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3624157c-89e9-4dd3-bd28-b281d14a42da" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.211828] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3624157c-89e9-4dd3-bd28-b281d14a42da" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.212110] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3624157c-89e9-4dd3-bd28-b281d14a42da" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.212181] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3624157c-89e9-4dd3-bd28-b281d14a42da',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1252.710180] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-12570d95-0a4a-4579-82c8-53ecf65f714e taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.710330] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-12570d95-0a4a-4579-82c8-53ecf65f714e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.714854] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3624157c-89e9-4dd3-bd28-b281d14a42da with status ACTIVE [ 1252.715488] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.715488] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.715488] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.715705] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.715803] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.715990] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.716131] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.716191] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.716344] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.716431] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.716598] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.716958] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.717124] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.717175] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.717256] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.717343] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3624157c-89e9-4dd3-bd28-b281d14a42da is going to be updated. [ 1252.718475] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('12570d95-0a4a-4579-82c8-53ecf65f714e',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1252.741174] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.741407] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.741460] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.741779] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.741957] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.742143] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3624157c-89e9-4dd3-bd28-b281d14a42da" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.221468] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('12570d95-0a4a-4579-82c8-53ecf65f714e',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1253.727789] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.728021] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.728107] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.728435] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.728557] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.728710] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 12570d95-0a4a-4579-82c8-53ecf65f714e is going to be updated. [ 1253.766612] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.766788] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.766867] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.767192] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.767365] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.775763] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 12570d95-0a4a-4579-82c8-53ecf65f714e in Status: IN_PROGRESS for 2s [ 1255.789023] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 12570d95-0a4a-4579-82c8-53ecf65f714e in Status: SUCCESS [ 1255.789023] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-12570d95-0a4a-4579-82c8-53ecf65f714e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.789023] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-12570d95-0a4a-4579-82c8-53ecf65f714e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.789366] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-12570d95-0a4a-4579-82c8-53ecf65f714e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.789366] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.789519] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.789575] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.789715] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.789790] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.789880] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-12570d95-0a4a-4579-82c8-53ecf65f714e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.789971] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('12570d95-0a4a-4579-82c8-53ecf65f714e',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1256.292328] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-12570d95-0a4a-4579-82c8-53ecf65f714e taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.292499] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-12570d95-0a4a-4579-82c8-53ecf65f714e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.292577] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-12570d95-0a4a-4579-82c8-53ecf65f714e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.292792] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-12570d95-0a4a-4579-82c8-53ecf65f714e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.292959] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.293077] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.293138] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.293283] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.293370] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.293457] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-12570d95-0a4a-4579-82c8-53ecf65f714e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.293599] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-12570d95-0a4a-4579-82c8-53ecf65f714e taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.293689] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-12570d95-0a4a-4579-82c8-53ecf65f714e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.294283] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-12570d95-0a4a-4579-82c8-53ecf65f714e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.294283] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-12570d95-0a4a-4579-82c8-53ecf65f714e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.294283] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.294283] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.294283] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.294531] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.294531] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.294531] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-12570d95-0a4a-4579-82c8-53ecf65f714e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.294617] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('12570d95-0a4a-4579-82c8-53ecf65f714e',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1256.796233] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 12570d95-0a4a-4579-82c8-53ecf65f714e: rpc.has_security_group_logging(os_id): False [ 1256.813384] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.813545] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.813601] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.813821] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.813911] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.814145] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.814265] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.814313] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.814445] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.814518] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.814740] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.814871] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.814944] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.815093] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.815165] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.815353] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.815444] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.815496] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.815639] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.815706] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.815792] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 12570d95-0a4a-4579-82c8-53ecf65f714e is going to be updated. [ 1256.873315] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.873553] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.873553] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.873765] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.873912] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.890620] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 12570d95-0a4a-4579-82c8-53ecf65f714e in Status: IN_PROGRESS for 2s [ 1257.207899] env[69188]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1257.208058] env[69188]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1258.911511] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 12570d95-0a4a-4579-82c8-53ecf65f714e in Status: SUCCESS [ 1258.911878] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-12570d95-0a4a-4579-82c8-53ecf65f714e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.208986] env[69188]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1262.209361] env[69188]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1267.210082] env[69188]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1267.210433] env[69188]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1267.311356] env[69188]: INFO networking_nsxv3.common.synchronization [req-0726e70b-d0e0-4c29-a944-8eec01fabd9d req-fffd8a90-5f09-4ff3-9874-2b6cdd7c440a tempest-AttachInterfacesTestJSON-1255877948 tempest-AttachInterfacesTestJSON-1255877948-project-member] Enqueued Resource ID: 2a389e0c-0be3-41c9-986c-f4b06040a24d with Priority: HIGHEST for action security_group_members [ 1267.311910] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2a389e0c-0be3-41c9-986c-f4b06040a24d with Priority: HIGHEST for action security_group_members [ 1267.312235] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-2a389e0c-0be3-41c9-986c-f4b06040a24d taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.312360] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2a389e0c-0be3-41c9-986c-f4b06040a24d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.312454] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2a389e0c-0be3-41c9-986c-f4b06040a24d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.312674] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2a389e0c-0be3-41c9-986c-f4b06040a24d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.312828] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.312936] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.313020] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.313130] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.313210] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.313315] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2a389e0c-0be3-41c9-986c-f4b06040a24d',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1267.815409] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2a389e0c-0be3-41c9-986c-f4b06040a24d',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1268.317602] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2a389e0c-0be3-41c9-986c-f4b06040a24d',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1268.819545] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.819708] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.819780] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.819998] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.820107] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1268.820206] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2a389e0c-0be3-41c9-986c-f4b06040a24d is going to be updated. [ 1268.848191] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.848414] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.848414] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.848597] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.848737] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1268.857844] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2a389e0c-0be3-41c9-986c-f4b06040a24d in Status: IN_PROGRESS for 2s [ 1270.868548] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2a389e0c-0be3-41c9-986c-f4b06040a24d in Status: SUCCESS [ 1270.868888] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2a389e0c-0be3-41c9-986c-f4b06040a24d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.377508] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock network-154 taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.377770] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "network-154" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.377944] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "network-154" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.378277] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "network-154" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.378577] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.378774] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.378907] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.379150] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.379309] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.379529] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1271.379635] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] NeedRegenerationException {{(pid=69188) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1271.379750] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] no value, waiting for create lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1271.379861] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] value creation lock acquired {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1271.379972] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1271.380094] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Calling creation function for not-yet-present value {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1271.380230] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1271.399252] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1271.399416] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69188) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1271.399553] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Released creation lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1271.399722] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "network-154" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.399995] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock port-0bf18a15-bdc8-4dc8-a0f7-514d44d02d6e taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.400172] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "port-0bf18a15-bdc8-4dc8-a0f7-514d44d02d6e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.400294] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "port-0bf18a15-bdc8-4dc8-a0f7-514d44d02d6e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.400548] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "port-0bf18a15-bdc8-4dc8-a0f7-514d44d02d6e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.400688] env[69188]: DEBUG networking_nsxv3.api.rpc [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0bf18a15-bdc8-4dc8-a0f7-514d44d02d6e',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1271.903750] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.903750] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.903750] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.904299] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.904299] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.904552] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.904804] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.904968] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.905264] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.905452] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.905810] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.906032] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.906198] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.906463] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.906648] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.906871] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Resource: SegmentPort with ID: 0bf18a15-bdc8-4dc8-a0f7-514d44d02d6e is going to be updated. [ 1271.928905] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.929110] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.929240] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.929485] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.929723] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.929950] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "port-0bf18a15-bdc8-4dc8-a0f7-514d44d02d6e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.314920] env[69188]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1272.315055] env[69188]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1272.637351] env[69188]: INFO networking_nsxv3.common.synchronization [req-4e9fd66f-4fe2-4b00-a240-a436442ed4a6 req-7eee9505-9bc8-4cbe-a019-d0a32034692d service nova] Enqueued Resource ID: 867581e0-cbbd-4108-a823-0b7c53d47c3a with Priority: HIGHEST for action security_group_rules [ 1272.637535] env[69188]: INFO networking_nsxv3.common.synchronization [req-4e9fd66f-4fe2-4b00-a240-a436442ed4a6 req-7eee9505-9bc8-4cbe-a019-d0a32034692d service nova] Enqueued Resource ID: 867581e0-cbbd-4108-a823-0b7c53d47c3a with Priority: HIGHEST for action security_group_members [ 1272.637677] env[69188]: INFO networking_nsxv3.common.synchronization [req-4e9fd66f-4fe2-4b00-a240-a436442ed4a6 req-7eee9505-9bc8-4cbe-a019-d0a32034692d service nova] Enqueued Resource ID: 0bf18a15-bdc8-4dc8-a0f7-514d44d02d6e with Priority: HIGHEST for action port [ 1272.637910] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 867581e0-cbbd-4108-a823-0b7c53d47c3a with Priority: HIGHEST for action security_group_rules [ 1272.638050] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 867581e0-cbbd-4108-a823-0b7c53d47c3a with Priority: HIGHEST for action security_group_members [ 1272.638146] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0bf18a15-bdc8-4dc8-a0f7-514d44d02d6e with Priority: HIGHEST for action port [ 1272.638687] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-867581e0-cbbd-4108-a823-0b7c53d47c3a taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.638800] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-867581e0-cbbd-4108-a823-0b7c53d47c3a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.638867] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-867581e0-cbbd-4108-a823-0b7c53d47c3a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.639100] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-867581e0-cbbd-4108-a823-0b7c53d47c3a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.639186] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('867581e0-cbbd-4108-a823-0b7c53d47c3a',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1272.640352] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-867581e0-cbbd-4108-a823-0b7c53d47c3a taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.640488] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-867581e0-cbbd-4108-a823-0b7c53d47c3a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.640629] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-867581e0-cbbd-4108-a823-0b7c53d47c3a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.640730] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-867581e0-cbbd-4108-a823-0b7c53d47c3a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.640883] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.640977] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.641058] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.641190] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.641265] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.641378] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('867581e0-cbbd-4108-a823-0b7c53d47c3a',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1272.642344] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-0bf18a15-bdc8-4dc8-a0f7-514d44d02d6e taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.642344] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0bf18a15-bdc8-4dc8-a0f7-514d44d02d6e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.642344] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0bf18a15-bdc8-4dc8-a0f7-514d44d02d6e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.642344] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0bf18a15-bdc8-4dc8-a0f7-514d44d02d6e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.642665] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0bf18a15-bdc8-4dc8-a0f7-514d44d02d6e',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1273.144031] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-867581e0-cbbd-4108-a823-0b7c53d47c3a taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.144536] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-867581e0-cbbd-4108-a823-0b7c53d47c3a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.144536] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('867581e0-cbbd-4108-a823-0b7c53d47c3a',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1273.145303] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0bf18a15-bdc8-4dc8-a0f7-514d44d02d6e with status ACTIVE [ 1273.145491] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.145601] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.145672] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.145856] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.145947] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.146137] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.146234] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.146287] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.146440] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.146529] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.146711] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.146806] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.146859] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.146985] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.147070] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.147155] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0bf18a15-bdc8-4dc8-a0f7-514d44d02d6e is going to be updated. [ 1273.166800] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.167072] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.167072] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.167223] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.167360] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.167508] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0bf18a15-bdc8-4dc8-a0f7-514d44d02d6e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.649851] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('867581e0-cbbd-4108-a823-0b7c53d47c3a',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1274.153016] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.153344] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.153384] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.153640] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.153778] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.153943] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 867581e0-cbbd-4108-a823-0b7c53d47c3a is going to be updated. [ 1274.180065] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.180228] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.180268] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.180474] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.180616] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.188389] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 867581e0-cbbd-4108-a823-0b7c53d47c3a in Status: IN_PROGRESS for 2s [ 1275.814921] env[69188]: INFO networking_nsxv3.common.synchronization [req-835e2dbe-013a-4b22-a06b-eb9f521eb3a6 req-643cd823-5905-4e9e-9fc5-d6d26d8c0d41 tempest-AttachInterfacesTestJSON-1255877948 tempest-AttachInterfacesTestJSON-1255877948-project-member] Enqueued Resource ID: 2a389e0c-0be3-41c9-986c-f4b06040a24d with Priority: HIGHEST for action security_group_members [ 1275.816403] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2a389e0c-0be3-41c9-986c-f4b06040a24d with Priority: HIGHEST for action security_group_members [ 1275.816403] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-2a389e0c-0be3-41c9-986c-f4b06040a24d taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.816403] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2a389e0c-0be3-41c9-986c-f4b06040a24d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.816403] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2a389e0c-0be3-41c9-986c-f4b06040a24d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.816602] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2a389e0c-0be3-41c9-986c-f4b06040a24d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.816686] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.816812] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.816899] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.817308] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.817308] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.817308] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2a389e0c-0be3-41c9-986c-f4b06040a24d',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1276.199133] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 867581e0-cbbd-4108-a823-0b7c53d47c3a in Status: SUCCESS [ 1276.199390] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-867581e0-cbbd-4108-a823-0b7c53d47c3a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.199573] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-867581e0-cbbd-4108-a823-0b7c53d47c3a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.199808] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-867581e0-cbbd-4108-a823-0b7c53d47c3a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.200034] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.200176] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.200255] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.200445] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.200533] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.200623] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-867581e0-cbbd-4108-a823-0b7c53d47c3a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.200741] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('867581e0-cbbd-4108-a823-0b7c53d47c3a',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1276.320053] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.320282] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.320282] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.320492] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.320595] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.320768] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.320883] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.320953] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.321122] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.321200] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.321302] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2a389e0c-0be3-41c9-986c-f4b06040a24d is going to be updated. [ 1276.346152] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.346311] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.346374] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.346565] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.346706] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.355714] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2a389e0c-0be3-41c9-986c-f4b06040a24d in Status: IN_PROGRESS for 2s [ 1276.703014] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('867581e0-cbbd-4108-a823-0b7c53d47c3a',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1277.205955] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 867581e0-cbbd-4108-a823-0b7c53d47c3a: rpc.has_security_group_logging(os_id): False [ 1277.224572] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.224769] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.224829] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.224991] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.225095] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.225357] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.225476] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.225534] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.225722] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.225807] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.225894] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 867581e0-cbbd-4108-a823-0b7c53d47c3a is going to be updated. [ 1277.283670] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.283817] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.283894] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.284133] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.284282] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.295832] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 867581e0-cbbd-4108-a823-0b7c53d47c3a in Status: IN_PROGRESS for 2s [ 1278.364934] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2a389e0c-0be3-41c9-986c-f4b06040a24d in Status: SUCCESS [ 1278.365332] env[69188]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2a389e0c-0be3-41c9-986c-f4b06040a24d deletion is rescheduled due to dependency. [ 1278.365332] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2a389e0c-0be3-41c9-986c-f4b06040a24d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.311670] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 867581e0-cbbd-4108-a823-0b7c53d47c3a in Status: SUCCESS [ 1279.311916] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-867581e0-cbbd-4108-a823-0b7c53d47c3a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.212450] env[69188]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-ca0141f8-e0d0-45bb-94d3-6579b85b932c None None] NSXv3 Agent Agent loop - iteration:2 completed [ 1280.212883] env[69188]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-ca0141f8-e0d0-45bb-94d3-6579b85b932c None None] NSXv3 Agent Agent loop - iteration:3 started [ 1280.286459] env[69188]: INFO networking_nsxv3.common.synchronization [None req-1446c193-202c-4f66-908f-5183fda8ecc7 tempest-AttachInterfacesTestJSON-1255877948 tempest-AttachInterfacesTestJSON-1255877948-project-member] Enqueued Resource ID: 12570d95-0a4a-4579-82c8-53ecf65f714e with Priority: HIGHEST for action security_group_members [ 1280.287183] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 12570d95-0a4a-4579-82c8-53ecf65f714e with Priority: HIGHEST for action security_group_members [ 1280.287312] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-12570d95-0a4a-4579-82c8-53ecf65f714e taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.288194] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-12570d95-0a4a-4579-82c8-53ecf65f714e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.288315] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-12570d95-0a4a-4579-82c8-53ecf65f714e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.288567] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-12570d95-0a4a-4579-82c8-53ecf65f714e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.288742] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.288854] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.288915] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.289556] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.289556] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.289556] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('12570d95-0a4a-4579-82c8-53ecf65f714e',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1280.791299] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.791541] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.791541] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.791757] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.791905] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.792064] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.792183] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.792245] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.792413] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.792489] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.792656] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 12570d95-0a4a-4579-82c8-53ecf65f714e is going to be updated. [ 1280.820759] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.821016] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.821016] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.821294] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.821442] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.833483] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 12570d95-0a4a-4579-82c8-53ecf65f714e in Status: IN_PROGRESS for 2s [ 1282.844907] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 12570d95-0a4a-4579-82c8-53ecf65f714e in Status: SUCCESS [ 1282.845270] env[69188]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 12570d95-0a4a-4579-82c8-53ecf65f714e deletion is rescheduled due to dependency. [ 1282.845434] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-12570d95-0a4a-4579-82c8-53ecf65f714e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.748444] env[69188]: INFO networking_nsxv3.common.synchronization [None req-c4241e30-ca3c-46a5-8d23-c6e966b0b9b2 None None] Enqueued Resource ID: 496a6986-298d-4124-8ecc-946f381196e2 with Priority: HIGHEST for action port [ 1284.751789] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 496a6986-298d-4124-8ecc-946f381196e2 with Priority: HIGHEST for action port [ 1284.755687] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-496a6986-298d-4124-8ecc-946f381196e2 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.755931] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-496a6986-298d-4124-8ecc-946f381196e2" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.756397] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-496a6986-298d-4124-8ecc-946f381196e2" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.756397] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-496a6986-298d-4124-8ecc-946f381196e2" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.756482] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('496a6986-298d-4124-8ecc-946f381196e2',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1285.264284] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 496a6986-298d-4124-8ecc-946f381196e2 [ 1285.264284] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.264284] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.264284] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.264284] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.264284] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.264284] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:496a6986-298d-4124-8ecc-946f381196e2 already deleted. [ 1285.264284] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-496a6986-298d-4124-8ecc-946f381196e2" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.373017] env[69188]: INFO networking_nsxv3.common.synchronization [None req-7bbc64a0-638f-4731-80fe-a00b1265970f tempest-ServerActionsTestOtherA-1252171107 tempest-ServerActionsTestOtherA-1252171107-project-member] Enqueued Resource ID: 2fc127c1-64d5-4545-935d-5499e2e4234b with Priority: HIGHEST for action security_group_rules [ 1285.373017] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2fc127c1-64d5-4545-935d-5499e2e4234b with Priority: HIGHEST for action security_group_rules [ 1285.373017] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2fc127c1-64d5-4545-935d-5499e2e4234b taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.373017] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2fc127c1-64d5-4545-935d-5499e2e4234b" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.373017] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2fc127c1-64d5-4545-935d-5499e2e4234b" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.373017] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2fc127c1-64d5-4545-935d-5499e2e4234b" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.373017] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2fc127c1-64d5-4545-935d-5499e2e4234b',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1285.476018] env[69188]: INFO networking_nsxv3.common.synchronization [None req-ebb3f1d1-3609-42f1-b58d-256740f483b6 tempest-ServerActionsTestOtherA-1252171107 tempest-ServerActionsTestOtherA-1252171107-project-member] Enqueued Resource ID: 2fc127c1-64d5-4545-935d-5499e2e4234b with Priority: HIGHEST for action security_group_rules [ 1285.477401] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2fc127c1-64d5-4545-935d-5499e2e4234b with Priority: HIGHEST for action security_group_rules [ 1285.479339] env[69188]: INFO networking_nsxv3.common.synchronization [req-6815609f-d5d2-47ac-9169-c94026e0a374 req-617d4187-4a07-4126-9043-48280fd9e1ba tempest-ServerActionsTestJSON-1027345226 tempest-ServerActionsTestJSON-1027345226-project-member] Enqueued Resource ID: 9482bec7-7d68-4fe1-8d77-d380c3f6dc7a with Priority: HIGHEST for action security_group_members [ 1285.480130] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2fc127c1-64d5-4545-935d-5499e2e4234b taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.480405] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2fc127c1-64d5-4545-935d-5499e2e4234b" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.480725] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9482bec7-7d68-4fe1-8d77-d380c3f6dc7a with Priority: HIGHEST for action security_group_members [ 1285.481161] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-9482bec7-7d68-4fe1-8d77-d380c3f6dc7a taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.481428] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9482bec7-7d68-4fe1-8d77-d380c3f6dc7a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.483543] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9482bec7-7d68-4fe1-8d77-d380c3f6dc7a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.483543] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9482bec7-7d68-4fe1-8d77-d380c3f6dc7a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.483543] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.483543] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.483543] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.483543] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.483543] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.483543] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9482bec7-7d68-4fe1-8d77-d380c3f6dc7a',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1285.891270] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.891694] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.891694] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.891783] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.891818] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.891904] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2fc127c1-64d5-4545-935d-5499e2e4234b already deleted. [ 1285.891991] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2fc127c1-64d5-4545-935d-5499e2e4234b" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.892176] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2fc127c1-64d5-4545-935d-5499e2e4234b" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.892332] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2fc127c1-64d5-4545-935d-5499e2e4234b" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.892409] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2fc127c1-64d5-4545-935d-5499e2e4234b',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1285.985628] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.985837] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.985932] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.986209] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.986296] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.986517] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.986642] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.986678] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.986849] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.986941] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.987054] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9482bec7-7d68-4fe1-8d77-d380c3f6dc7a is going to be updated. [ 1286.015659] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1286.017445] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1286.017445] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1286.017445] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1286.017445] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1286.024143] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9482bec7-7d68-4fe1-8d77-d380c3f6dc7a in Status: IN_PROGRESS for 2s [ 1286.416763] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1286.416995] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1286.417166] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1286.417311] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1286.417411] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1286.417489] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2fc127c1-64d5-4545-935d-5499e2e4234b already deleted. [ 1286.417569] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2fc127c1-64d5-4545-935d-5499e2e4234b" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1287.049845] env[69188]: INFO networking_nsxv3.common.synchronization [None req-b4c1f5f3-9e13-4ca3-91c8-7b45c0102b21 None None] Enqueued Resource ID: b11405f8-2bb8-4f07-a2cc-000b7ae3c174 with Priority: HIGHEST for action port [ 1287.050182] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b11405f8-2bb8-4f07-a2cc-000b7ae3c174 with Priority: HIGHEST for action port [ 1287.051125] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-b11405f8-2bb8-4f07-a2cc-000b7ae3c174 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1287.051125] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b11405f8-2bb8-4f07-a2cc-000b7ae3c174" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1287.051125] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b11405f8-2bb8-4f07-a2cc-000b7ae3c174" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1287.051363] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b11405f8-2bb8-4f07-a2cc-000b7ae3c174" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1287.051363] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b11405f8-2bb8-4f07-a2cc-000b7ae3c174',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1287.553674] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b11405f8-2bb8-4f07-a2cc-000b7ae3c174 [ 1287.553960] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1287.554112] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1287.554183] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1287.554422] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1287.554514] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1287.554610] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b11405f8-2bb8-4f07-a2cc-000b7ae3c174 already deleted. [ 1287.554692] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b11405f8-2bb8-4f07-a2cc-000b7ae3c174" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.033075] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9482bec7-7d68-4fe1-8d77-d380c3f6dc7a in Status: SUCCESS [ 1288.033273] env[69188]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9482bec7-7d68-4fe1-8d77-d380c3f6dc7a deletion is rescheduled due to dependency. [ 1288.033320] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9482bec7-7d68-4fe1-8d77-d380c3f6dc7a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1290.458438] env[69188]: INFO networking_nsxv3.common.synchronization [req-e9970eca-d82c-4930-9e1c-b063ce9cc7b1 req-a3874746-2b43-498f-be80-12127c015045 tempest-ServerActionsTestOtherB-2131451762 tempest-ServerActionsTestOtherB-2131451762-project-member] Enqueued Resource ID: 867581e0-cbbd-4108-a823-0b7c53d47c3a with Priority: HIGHEST for action security_group_members [ 1290.458997] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 867581e0-cbbd-4108-a823-0b7c53d47c3a with Priority: HIGHEST for action security_group_members [ 1290.459312] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-867581e0-cbbd-4108-a823-0b7c53d47c3a taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1290.459434] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-867581e0-cbbd-4108-a823-0b7c53d47c3a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.459503] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-867581e0-cbbd-4108-a823-0b7c53d47c3a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1290.459697] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-867581e0-cbbd-4108-a823-0b7c53d47c3a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1290.461720] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1290.461720] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.461720] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1290.469765] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1290.469765] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1290.469765] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('867581e0-cbbd-4108-a823-0b7c53d47c3a',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1290.972505] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1290.973391] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.973391] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1290.973391] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1290.973391] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1290.973391] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1290.973595] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.973595] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1290.973698] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1290.973734] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1290.973861] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 867581e0-cbbd-4108-a823-0b7c53d47c3a is going to be updated. [ 1291.003043] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1291.003313] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1291.003313] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1291.003569] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1291.003839] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1291.013212] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 867581e0-cbbd-4108-a823-0b7c53d47c3a in Status: IN_PROGRESS for 2s [ 1291.850092] env[69188]: INFO networking_nsxv3.common.synchronization [req-bbd9650c-8f31-4d82-9eaa-d3cbd93d9768 req-95aaf145-1df8-40a9-8efa-ef4790a42244 tempest-ServerActionsTestOtherA-1252171107 tempest-ServerActionsTestOtherA-1252171107-project-member] Enqueued Resource ID: 2fc127c1-64d5-4545-935d-5499e2e4234b with Priority: HIGHEST for action security_group_members [ 1291.850622] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2fc127c1-64d5-4545-935d-5499e2e4234b with Priority: HIGHEST for action security_group_members [ 1291.850914] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-2fc127c1-64d5-4545-935d-5499e2e4234b taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1291.851045] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2fc127c1-64d5-4545-935d-5499e2e4234b" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1291.851107] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2fc127c1-64d5-4545-935d-5499e2e4234b" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1291.851358] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2fc127c1-64d5-4545-935d-5499e2e4234b" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1291.851505] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1291.851600] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1291.851656] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1291.851803] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1291.851884] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1291.851990] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2fc127c1-64d5-4545-935d-5499e2e4234b',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1292.174679] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock network-657 taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.174878] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "network-657" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.175019] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "network-657" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.175299] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "network-657" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.175562] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.175718] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.175836] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.176062] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.176216] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.176444] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1292.176641] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] NeedRegenerationException {{(pid=69188) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1292.176712] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] no value, waiting for create lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1292.176775] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] value creation lock acquired {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1292.176886] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1292.176998] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Calling creation function for not-yet-present value {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1292.177147] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1292.195536] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1292.195683] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69188) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1292.196548] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Released creation lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1292.196548] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "network-657" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.196548] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock port-7eb2b25d-639a-40a8-8911-33b5eaec5920 taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.196548] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "port-7eb2b25d-639a-40a8-8911-33b5eaec5920" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.196548] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "port-7eb2b25d-639a-40a8-8911-33b5eaec5920" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.196861] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "port-7eb2b25d-639a-40a8-8911-33b5eaec5920" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.196985] env[69188]: DEBUG networking_nsxv3.api.rpc [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7eb2b25d-639a-40a8-8911-33b5eaec5920',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1292.355638] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.355638] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.355638] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.355638] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.355638] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.355638] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.355638] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.355638] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.355638] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.356106] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.356106] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2fc127c1-64d5-4545-935d-5499e2e4234b already deleted. [ 1292.356106] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2fc127c1-64d5-4545-935d-5499e2e4234b" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.698931] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.699231] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.699401] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.699711] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.699901] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.700102] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Segment Port 7eb2b25d-639a-40a8-8911-33b5eaec5920 not found, creating... [ 1292.701166] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.701166] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.701166] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.701166] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.701166] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.701496] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.701571] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.701656] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.702102] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.702102] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.702221] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Resource: SegmentPort with ID: 7eb2b25d-639a-40a8-8911-33b5eaec5920 is going to be created. [ 1292.721366] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.721664] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.721862] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.722203] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.722418] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.722743] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "port-7eb2b25d-639a-40a8-8911-33b5eaec5920" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.025491] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 867581e0-cbbd-4108-a823-0b7c53d47c3a in Status: SUCCESS [ 1293.025807] env[69188]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 867581e0-cbbd-4108-a823-0b7c53d47c3a deletion is rescheduled due to dependency. [ 1293.025807] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-867581e0-cbbd-4108-a823-0b7c53d47c3a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.465144] env[69188]: INFO networking_nsxv3.common.synchronization [req-bbd9650c-8f31-4d82-9eaa-d3cbd93d9768 req-f76e4ea9-5c19-4b32-af2c-d0d83e5c46b5 service nova] Enqueued Resource ID: 2fc127c1-64d5-4545-935d-5499e2e4234b with Priority: HIGHEST for action security_group_rules [ 1293.465320] env[69188]: INFO networking_nsxv3.common.synchronization [req-bbd9650c-8f31-4d82-9eaa-d3cbd93d9768 req-f76e4ea9-5c19-4b32-af2c-d0d83e5c46b5 service nova] Enqueued Resource ID: 2fc127c1-64d5-4545-935d-5499e2e4234b with Priority: HIGHEST for action security_group_members [ 1293.465466] env[69188]: INFO networking_nsxv3.common.synchronization [req-bbd9650c-8f31-4d82-9eaa-d3cbd93d9768 req-f76e4ea9-5c19-4b32-af2c-d0d83e5c46b5 service nova] Enqueued Resource ID: 7eb2b25d-639a-40a8-8911-33b5eaec5920 with Priority: HIGHEST for action port [ 1293.465705] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2fc127c1-64d5-4545-935d-5499e2e4234b with Priority: HIGHEST for action security_group_rules [ 1293.465831] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2fc127c1-64d5-4545-935d-5499e2e4234b with Priority: HIGHEST for action security_group_members [ 1293.465928] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7eb2b25d-639a-40a8-8911-33b5eaec5920 with Priority: HIGHEST for action port [ 1293.466477] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2fc127c1-64d5-4545-935d-5499e2e4234b taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.466602] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2fc127c1-64d5-4545-935d-5499e2e4234b" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.466670] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2fc127c1-64d5-4545-935d-5499e2e4234b" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.466874] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2fc127c1-64d5-4545-935d-5499e2e4234b" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.466955] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2fc127c1-64d5-4545-935d-5499e2e4234b',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1293.467765] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-2fc127c1-64d5-4545-935d-5499e2e4234b taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.467862] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2fc127c1-64d5-4545-935d-5499e2e4234b" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.467932] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2fc127c1-64d5-4545-935d-5499e2e4234b" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.468110] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2fc127c1-64d5-4545-935d-5499e2e4234b" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.468254] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.468347] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.468408] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.468546] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.468645] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.468708] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2fc127c1-64d5-4545-935d-5499e2e4234b',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1293.471146] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-7eb2b25d-639a-40a8-8911-33b5eaec5920 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.471146] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7eb2b25d-639a-40a8-8911-33b5eaec5920" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.471146] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7eb2b25d-639a-40a8-8911-33b5eaec5920" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.471146] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7eb2b25d-639a-40a8-8911-33b5eaec5920" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.471146] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7eb2b25d-639a-40a8-8911-33b5eaec5920',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1293.916435] env[69188]: INFO networking_nsxv3.common.synchronization [None req-15011fe2-bfc1-4851-b441-c583a655ac3c None None] Enqueued Resource ID: 94a3b3b1-1734-45b8-93f0-31f6647293da with Priority: HIGHEST for action port [ 1293.916698] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 94a3b3b1-1734-45b8-93f0-31f6647293da with Priority: HIGHEST for action port [ 1293.917254] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-94a3b3b1-1734-45b8-93f0-31f6647293da taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.917393] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-94a3b3b1-1734-45b8-93f0-31f6647293da" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.917461] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-94a3b3b1-1734-45b8-93f0-31f6647293da" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.917734] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-94a3b3b1-1734-45b8-93f0-31f6647293da" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.917820] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('94a3b3b1-1734-45b8-93f0-31f6647293da',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1293.971731] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2fc127c1-64d5-4545-935d-5499e2e4234b',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1293.972655] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-2fc127c1-64d5-4545-935d-5499e2e4234b taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.972781] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2fc127c1-64d5-4545-935d-5499e2e4234b" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.977583] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7eb2b25d-639a-40a8-8911-33b5eaec5920 with status ACTIVE [ 1293.977764] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.977873] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.977936] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.978148] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.978238] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.978410] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.978504] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.978565] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.978873] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.978873] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.979031] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.979031] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.979167] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.979239] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.979303] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.979387] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7eb2b25d-639a-40a8-8911-33b5eaec5920 is going to be updated. [ 1294.002649] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.002860] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.002860] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.003088] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.003195] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.003349] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7eb2b25d-639a-40a8-8911-33b5eaec5920" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.420210] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 94a3b3b1-1734-45b8-93f0-31f6647293da [ 1294.420488] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.420587] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.420646] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.421199] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.421199] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.421199] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:94a3b3b1-1734-45b8-93f0-31f6647293da already deleted. [ 1294.421199] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-94a3b3b1-1734-45b8-93f0-31f6647293da" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.474251] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2fc127c1-64d5-4545-935d-5499e2e4234b',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1294.977249] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.977381] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.977442] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.977649] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.977739] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.977841] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2fc127c1-64d5-4545-935d-5499e2e4234b is going to be created. [ 1294.999628] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.999800] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.999964] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.000096] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.000266] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.010119] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2fc127c1-64d5-4545-935d-5499e2e4234b in Status: UNINITIALIZED for 2s [ 1295.872370] env[69188]: INFO networking_nsxv3.common.synchronization [None req-cc531278-f386-465d-a33c-2d5abfea41e1 None None] Enqueued Resource ID: 1a305da7-2dad-4fdf-b7a1-de8a9c52adfa with Priority: HIGHEST for action port [ 1295.872688] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1a305da7-2dad-4fdf-b7a1-de8a9c52adfa with Priority: HIGHEST for action port [ 1295.873333] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-1a305da7-2dad-4fdf-b7a1-de8a9c52adfa taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.873500] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1a305da7-2dad-4fdf-b7a1-de8a9c52adfa" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.873664] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1a305da7-2dad-4fdf-b7a1-de8a9c52adfa" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.873873] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1a305da7-2dad-4fdf-b7a1-de8a9c52adfa" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.874010] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1a305da7-2dad-4fdf-b7a1-de8a9c52adfa',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1296.376689] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1a305da7-2dad-4fdf-b7a1-de8a9c52adfa [ 1296.376926] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.377079] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.377204] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.377352] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.377443] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.377539] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1a305da7-2dad-4fdf-b7a1-de8a9c52adfa already deleted. [ 1296.377709] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1a305da7-2dad-4fdf-b7a1-de8a9c52adfa" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.020877] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2fc127c1-64d5-4545-935d-5499e2e4234b in Status: SUCCESS [ 1297.021157] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2fc127c1-64d5-4545-935d-5499e2e4234b" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.021292] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2fc127c1-64d5-4545-935d-5499e2e4234b" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.021504] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2fc127c1-64d5-4545-935d-5499e2e4234b" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.021691] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.021812] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.021877] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.022035] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.022121] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.022261] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2fc127c1-64d5-4545-935d-5499e2e4234b" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.022313] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2fc127c1-64d5-4545-935d-5499e2e4234b',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1297.524703] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2fc127c1-64d5-4545-935d-5499e2e4234b',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1298.026765] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2fc127c1-64d5-4545-935d-5499e2e4234b: rpc.has_security_group_logging(os_id): False [ 1298.044545] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.044705] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.044769] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.044964] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.045085] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.045353] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.045457] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.045522] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.045682] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.045780] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.045870] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2fc127c1-64d5-4545-935d-5499e2e4234b is going to be created. [ 1298.108427] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.108601] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.108601] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.108795] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.108969] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.120831] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2fc127c1-64d5-4545-935d-5499e2e4234b in Status: IN_PROGRESS for 2s [ 1299.147929] env[69188]: INFO networking_nsxv3.common.synchronization [req-b6b076ab-b73a-42b6-85f8-f45ccac3fca6 req-c475fdf0-382d-4ac9-b1c5-c225304cbcba tempest-ServerMetadataNegativeTestJSON-1276995623 tempest-ServerMetadataNegativeTestJSON-1276995623-project-member] Enqueued Resource ID: 1e2a81ad-1ea5-41c4-9fcb-b28a27366214 with Priority: HIGHEST for action security_group_members [ 1299.148531] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e2a81ad-1ea5-41c4-9fcb-b28a27366214 with Priority: HIGHEST for action security_group_members [ 1299.148839] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e2a81ad-1ea5-41c4-9fcb-b28a27366214 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.148963] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e2a81ad-1ea5-41c4-9fcb-b28a27366214" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.149042] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e2a81ad-1ea5-41c4-9fcb-b28a27366214" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.149319] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e2a81ad-1ea5-41c4-9fcb-b28a27366214" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.149474] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.149588] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.149624] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.149770] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.149854] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.149947] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1e2a81ad-1ea5-41c4-9fcb-b28a27366214',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1299.400821] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock network-793 taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.401049] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "network-793" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.401182] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "network-793" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.401518] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "network-793" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.401787] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.401947] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.402185] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.402452] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.402635] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.402918] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1299.403085] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] NeedRegenerationException {{(pid=69188) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1299.403232] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] no value, waiting for create lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1299.403368] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] value creation lock acquired {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1299.403597] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1299.403667] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Calling creation function for not-yet-present value {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1299.403922] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1299.425866] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1299.425866] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69188) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1299.425866] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Released creation lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1299.425866] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "network-793" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.425866] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock port-3c6eb5f9-e16a-4776-bf60-799e4914b4aa taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.425866] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "port-3c6eb5f9-e16a-4776-bf60-799e4914b4aa" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.425866] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "port-3c6eb5f9-e16a-4776-bf60-799e4914b4aa" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.425866] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "port-3c6eb5f9-e16a-4776-bf60-799e4914b4aa" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.425866] env[69188]: DEBUG networking_nsxv3.api.rpc [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3c6eb5f9-e16a-4776-bf60-799e4914b4aa',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1299.653019] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.653219] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.653219] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.653423] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.653561] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.653800] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.653927] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.653976] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.654165] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.654244] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.654333] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1e2a81ad-1ea5-41c4-9fcb-b28a27366214 already deleted. [ 1299.654410] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e2a81ad-1ea5-41c4-9fcb-b28a27366214" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.927668] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.927936] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.928083] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.928369] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.928528] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.928724] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Segment Port 3c6eb5f9-e16a-4776-bf60-799e4914b4aa not found, creating... [ 1299.928998] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.929190] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.929307] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.929585] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.929659] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.929967] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.930152] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.930276] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.930483] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.930621] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.930786] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Resource: SegmentPort with ID: 3c6eb5f9-e16a-4776-bf60-799e4914b4aa is going to be created. [ 1299.958455] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.958732] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.958874] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.959143] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.959367] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.959594] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "port-3c6eb5f9-e16a-4776-bf60-799e4914b4aa" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.143032] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2fc127c1-64d5-4545-935d-5499e2e4234b in Status: SUCCESS [ 1300.143280] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2fc127c1-64d5-4545-935d-5499e2e4234b" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.713248] env[69188]: INFO networking_nsxv3.common.synchronization [req-b6b076ab-b73a-42b6-85f8-f45ccac3fca6 req-a28605eb-205a-4960-8c8b-d98af2de1004 service nova] Enqueued Resource ID: 1e2a81ad-1ea5-41c4-9fcb-b28a27366214 with Priority: HIGHEST for action security_group_rules [ 1300.713248] env[69188]: INFO networking_nsxv3.common.synchronization [req-b6b076ab-b73a-42b6-85f8-f45ccac3fca6 req-a28605eb-205a-4960-8c8b-d98af2de1004 service nova] Enqueued Resource ID: 1e2a81ad-1ea5-41c4-9fcb-b28a27366214 with Priority: HIGHEST for action security_group_members [ 1300.713591] env[69188]: INFO networking_nsxv3.common.synchronization [req-b6b076ab-b73a-42b6-85f8-f45ccac3fca6 req-a28605eb-205a-4960-8c8b-d98af2de1004 service nova] Enqueued Resource ID: 3c6eb5f9-e16a-4776-bf60-799e4914b4aa with Priority: HIGHEST for action port [ 1300.714584] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e2a81ad-1ea5-41c4-9fcb-b28a27366214 with Priority: HIGHEST for action security_group_rules [ 1300.714584] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e2a81ad-1ea5-41c4-9fcb-b28a27366214 with Priority: HIGHEST for action security_group_members [ 1300.714759] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3c6eb5f9-e16a-4776-bf60-799e4914b4aa with Priority: HIGHEST for action port [ 1300.715402] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1e2a81ad-1ea5-41c4-9fcb-b28a27366214 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.715567] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1e2a81ad-1ea5-41c4-9fcb-b28a27366214" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.715665] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1e2a81ad-1ea5-41c4-9fcb-b28a27366214" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.716767] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1e2a81ad-1ea5-41c4-9fcb-b28a27366214" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.716767] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1e2a81ad-1ea5-41c4-9fcb-b28a27366214',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1300.717441] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e2a81ad-1ea5-41c4-9fcb-b28a27366214 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.717645] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e2a81ad-1ea5-41c4-9fcb-b28a27366214" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.717747] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e2a81ad-1ea5-41c4-9fcb-b28a27366214" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.718081] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e2a81ad-1ea5-41c4-9fcb-b28a27366214" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.718269] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.719211] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.719414] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.719686] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.720167] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.720351] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1e2a81ad-1ea5-41c4-9fcb-b28a27366214',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1300.721690] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-3c6eb5f9-e16a-4776-bf60-799e4914b4aa taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.722134] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3c6eb5f9-e16a-4776-bf60-799e4914b4aa" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.722134] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3c6eb5f9-e16a-4776-bf60-799e4914b4aa" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.722134] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3c6eb5f9-e16a-4776-bf60-799e4914b4aa" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.722271] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3c6eb5f9-e16a-4776-bf60-799e4914b4aa',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1301.218348] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e2a81ad-1ea5-41c4-9fcb-b28a27366214 taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.218348] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e2a81ad-1ea5-41c4-9fcb-b28a27366214" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.222637] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1e2a81ad-1ea5-41c4-9fcb-b28a27366214',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1301.225683] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3c6eb5f9-e16a-4776-bf60-799e4914b4aa with status ACTIVE [ 1301.225877] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.225997] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.226082] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.226294] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.226384] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.226552] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.226691] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.226802] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.226965] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.227056] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.227261] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.227383] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.227476] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.227560] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.227635] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.227720] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3c6eb5f9-e16a-4776-bf60-799e4914b4aa is going to be updated. [ 1301.249872] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.250023] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.250086] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.250265] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.250397] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.250556] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3c6eb5f9-e16a-4776-bf60-799e4914b4aa" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.725941] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1e2a81ad-1ea5-41c4-9fcb-b28a27366214',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1302.228616] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.228772] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.228850] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.229114] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.229219] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.229327] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1e2a81ad-1ea5-41c4-9fcb-b28a27366214 is going to be created. [ 1302.252160] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.252295] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.252341] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.252504] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.252652] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.261952] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1e2a81ad-1ea5-41c4-9fcb-b28a27366214 in Status: UNINITIALIZED for 2s [ 1304.160340] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.160681] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.160681] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.162060] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.162060] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1304.272779] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1e2a81ad-1ea5-41c4-9fcb-b28a27366214 in Status: SUCCESS [ 1304.273058] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e2a81ad-1ea5-41c4-9fcb-b28a27366214" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.273229] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e2a81ad-1ea5-41c4-9fcb-b28a27366214" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.273441] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e2a81ad-1ea5-41c4-9fcb-b28a27366214" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.273636] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.273751] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.273824] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.274000] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.274097] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.274183] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e2a81ad-1ea5-41c4-9fcb-b28a27366214" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.274277] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1e2a81ad-1ea5-41c4-9fcb-b28a27366214',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1304.664337] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1304.776419] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e2a81ad-1ea5-41c4-9fcb-b28a27366214 taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.776634] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e2a81ad-1ea5-41c4-9fcb-b28a27366214" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.776634] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e2a81ad-1ea5-41c4-9fcb-b28a27366214" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.776837] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e2a81ad-1ea5-41c4-9fcb-b28a27366214" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.777023] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.777129] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.777192] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.777345] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.777432] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.777519] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e2a81ad-1ea5-41c4-9fcb-b28a27366214" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.777661] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e2a81ad-1ea5-41c4-9fcb-b28a27366214 taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.777752] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e2a81ad-1ea5-41c4-9fcb-b28a27366214" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.777814] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e2a81ad-1ea5-41c4-9fcb-b28a27366214" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.777950] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e2a81ad-1ea5-41c4-9fcb-b28a27366214" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.778097] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.778185] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.778243] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.778372] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.778445] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.778524] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e2a81ad-1ea5-41c4-9fcb-b28a27366214" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.778608] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1e2a81ad-1ea5-41c4-9fcb-b28a27366214',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1305.166740] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1305.281208] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1e2a81ad-1ea5-41c4-9fcb-b28a27366214: rpc.has_security_group_logging(os_id): False [ 1305.298948] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.299195] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.299195] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.299391] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.299484] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.299721] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.299824] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.299890] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.300110] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.300169] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.300314] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.300406] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.300558] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.300604] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.300670] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.300871] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.301014] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.301014] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.301135] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.301205] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.301286] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1e2a81ad-1ea5-41c4-9fcb-b28a27366214 is going to be created. [ 1305.358065] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.358271] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.358349] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.358528] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.358696] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.372748] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1e2a81ad-1ea5-41c4-9fcb-b28a27366214 in Status: IN_PROGRESS for 2s [ 1305.457210] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock network-796 taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.457441] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "network-796" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.457627] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "network-796" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.457910] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "network-796" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.458189] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.458395] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.458554] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.458787] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.458938] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.459198] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1305.459320] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] NeedRegenerationException {{(pid=69188) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1305.459433] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] no value, waiting for create lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1305.459547] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] value creation lock acquired {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1305.459664] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1305.459774] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Calling creation function for not-yet-present value {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1305.459911] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1305.478633] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1305.478796] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69188) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1305.478936] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Released creation lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1305.479136] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "network-796" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.479440] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock port-8d37fbe0-fdbc-4008-8c42-ec7afee8b2e6 taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.479611] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "port-8d37fbe0-fdbc-4008-8c42-ec7afee8b2e6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.479735] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "port-8d37fbe0-fdbc-4008-8c42-ec7afee8b2e6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.479992] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "port-8d37fbe0-fdbc-4008-8c42-ec7afee8b2e6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.480150] env[69188]: DEBUG networking_nsxv3.api.rpc [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8d37fbe0-fdbc-4008-8c42-ec7afee8b2e6',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1305.668722] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1305.668897] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1305.715456] env[69188]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1305.715728] env[69188]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1305.982317] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.982546] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.982595] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.982883] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.983071] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.983364] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.983525] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.983643] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.983873] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.984046] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.984335] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.984493] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.984612] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.984817] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.984972] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.985151] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Resource: SegmentPort with ID: 8d37fbe0-fdbc-4008-8c42-ec7afee8b2e6 is going to be updated. [ 1306.009424] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.009589] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.009708] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.009926] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.010128] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.010342] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "port-8d37fbe0-fdbc-4008-8c42-ec7afee8b2e6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.485462] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.485962] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.485962] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.485962] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.498591] env[69188]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1306.499438] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.500206] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1306.545599] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.545787] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.545787] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.546120] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.558731] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.559353] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1306.559437] env[69188]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=69188) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1306.559528] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1306.598560] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.598691] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.598774] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.598952] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.600141] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.600309] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1306.676958] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.677166] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.677282] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.677476] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.677890] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.678156] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1306.721182] env[69188]: INFO networking_nsxv3.common.synchronization [req-5def0777-c672-4803-9988-3b121f8e6579 req-0cd96fa2-464f-4d40-b855-79007aeadfbc service nova] Enqueued Resource ID: f85bb0c6-bf80-4499-b5c3-0b4c4169bdc0 with Priority: HIGHEST for action security_group_rules [ 1306.721364] env[69188]: INFO networking_nsxv3.common.synchronization [req-5def0777-c672-4803-9988-3b121f8e6579 req-0cd96fa2-464f-4d40-b855-79007aeadfbc service nova] Enqueued Resource ID: f85bb0c6-bf80-4499-b5c3-0b4c4169bdc0 with Priority: HIGHEST for action security_group_members [ 1306.721521] env[69188]: INFO networking_nsxv3.common.synchronization [req-5def0777-c672-4803-9988-3b121f8e6579 req-0cd96fa2-464f-4d40-b855-79007aeadfbc service nova] Enqueued Resource ID: 8d37fbe0-fdbc-4008-8c42-ec7afee8b2e6 with Priority: HIGHEST for action port [ 1306.721724] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f85bb0c6-bf80-4499-b5c3-0b4c4169bdc0 with Priority: HIGHEST for action security_group_rules [ 1306.721850] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f85bb0c6-bf80-4499-b5c3-0b4c4169bdc0 with Priority: HIGHEST for action security_group_members [ 1306.721942] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8d37fbe0-fdbc-4008-8c42-ec7afee8b2e6 with Priority: HIGHEST for action port [ 1306.722474] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f85bb0c6-bf80-4499-b5c3-0b4c4169bdc0 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.722595] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f85bb0c6-bf80-4499-b5c3-0b4c4169bdc0" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.722682] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f85bb0c6-bf80-4499-b5c3-0b4c4169bdc0" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.722894] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f85bb0c6-bf80-4499-b5c3-0b4c4169bdc0" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.722967] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f85bb0c6-bf80-4499-b5c3-0b4c4169bdc0',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1306.723748] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-f85bb0c6-bf80-4499-b5c3-0b4c4169bdc0 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.723914] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f85bb0c6-bf80-4499-b5c3-0b4c4169bdc0" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.723914] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f85bb0c6-bf80-4499-b5c3-0b4c4169bdc0" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.724113] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f85bb0c6-bf80-4499-b5c3-0b4c4169bdc0" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.724257] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.724355] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.724416] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.724542] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.724623] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.724706] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f85bb0c6-bf80-4499-b5c3-0b4c4169bdc0',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1306.725376] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-8d37fbe0-fdbc-4008-8c42-ec7afee8b2e6 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.725481] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8d37fbe0-fdbc-4008-8c42-ec7afee8b2e6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.725544] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8d37fbe0-fdbc-4008-8c42-ec7afee8b2e6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.725691] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8d37fbe0-fdbc-4008-8c42-ec7afee8b2e6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.725756] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8d37fbe0-fdbc-4008-8c42-ec7afee8b2e6',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1306.753551] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.753551] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.753765] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.753800] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.754114] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.754382] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:40. [ 1306.754475] env[69188]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'2240419a-b1eb-469c-b2f2-8c54a91fa4b9', '199db626-eef5-4a20-b92a-585841c1cff4', '397559b2-3c5a-424d-b09d-43a25d2abba6', '2a389e0c-0be3-41c9-986c-f4b06040a24d', '2fc127c1-64d5-4545-935d-5499e2e4234b', '0ba9367f-1279-4e82-9eaa-4519ee3a1efb', '6551850f-c3f5-470f-b5eb-f7d542ab3a90', 'e3296f55-96ac-44eb-a498-8c6ab147c5ab', 'c7e4a274-48d0-4c86-9db6-5b72611db3e7', 'fa6e8a6e-b63b-4248-b67b-4ae889fac90c', '1e2a81ad-1ea5-41c4-9fcb-b28a27366214', 'f85bb0c6-bf80-4499-b5c3-0b4c4169bdc0', '12570d95-0a4a-4579-82c8-53ecf65f714e', '9f2518e8-b195-4520-b262-caa765ab7e27', '143fbb10-efe2-4f17-a012-d41cc9b595b6', 'cd207b0a-02a6-4378-9240-c9d49160b653', '938f39e5-b2c4-4a5d-b8ea-03c277953ec9', '53a4d3c3-01ca-4828-94d1-6fa305c27650', '048d5e2e-adfe-4bc0-9ae5-f6d99d633e62', '4c598260-71fe-43f5-ab89-63a95724ea23', 'c019210a-f261-4200-a6cd-a6e2fc4f9396', '86b3e666-35a3-418a-82c9-eb305c030ea1', '5e76d42e-7ec6-4a5e-aa9c-c5a285d62318', 'bec5fbed-ec5a-4f98-90d3-ee0000b97d09', 'e5ba8b1f-5099-48fb-8bd0-c413eb3b39f7', '9482bec7-7d68-4fe1-8d77-d380c3f6dc7a', '460ab751-c0ea-45e9-bf76-9a767798212b', '5f183b9d-5066-4eee-a079-2adf3a1d0f7c', '870d4230-10cb-4ebd-8d12-34aaae29ea98', '867581e0-cbbd-4108-a823-0b7c53d47c3a', '53b2b927-2e3d-4111-b25a-7b34ab9fa28d', '55dcb887-f0db-4969-b757-e829798327eb', 'dbff1afa-14ec-4fad-8985-0fb6140d58bb', '9d153fe4-605f-47fe-a33b-9d019b977fa7', '721e26e3-d896-46ab-b5a3-92852a365813', 'b99e414b-ff9c-4d19-b3c8-32ab58288d75', '4e9db3bb-e903-42d7-b7e6-e365ea0c7f5f', '614b9fd7-ab13-4673-ace1-c5f03c5b9acc', '24a7b083-b432-46d6-94de-76adf6ce22b3', 'e275bda6-f504-45ea-9805-84ac49a67aa7'} {{(pid=69188) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1306.754582] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1306.771519] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.771670] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.771732] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.771881] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.771964] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.772080] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1306.772150] env[69188]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=69188) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1306.772219] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1306.854794] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.855080] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.855080] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.855199] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.856216] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.856450] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1306.856528] env[69188]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=69188) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1306.856599] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1306.856662] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1306.856783] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/40 resources of Type:Security Group Rules [ 1306.856845] env[69188]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 2240419a-b1eb-469c-b2f2-8c54a91fa4b9 with Priority: HIGH for action security_group_rules [ 1306.856894] env[69188]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 199db626-eef5-4a20-b92a-585841c1cff4 with Priority: HIGH for action security_group_rules [ 1306.856928] env[69188]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 397559b2-3c5a-424d-b09d-43a25d2abba6 with Priority: HIGH for action security_group_rules [ 1306.856995] env[69188]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 2a389e0c-0be3-41c9-986c-f4b06040a24d with Priority: HIGH for action security_group_rules [ 1306.857070] env[69188]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 2fc127c1-64d5-4545-935d-5499e2e4234b with Priority: HIGH for action security_group_rules [ 1306.857527] env[69188]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 0ba9367f-1279-4e82-9eaa-4519ee3a1efb with Priority: HIGH for action security_group_rules [ 1306.857527] env[69188]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 6551850f-c3f5-470f-b5eb-f7d542ab3a90 with Priority: HIGH for action security_group_rules [ 1306.857527] env[69188]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e3296f55-96ac-44eb-a498-8c6ab147c5ab with Priority: HIGH for action security_group_rules [ 1306.857527] env[69188]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c7e4a274-48d0-4c86-9db6-5b72611db3e7 with Priority: HIGH for action security_group_rules [ 1306.857527] env[69188]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: fa6e8a6e-b63b-4248-b67b-4ae889fac90c with Priority: HIGH for action security_group_rules [ 1306.857527] env[69188]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 1e2a81ad-1ea5-41c4-9fcb-b28a27366214 with Priority: HIGH for action security_group_rules [ 1306.857527] env[69188]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f85bb0c6-bf80-4499-b5c3-0b4c4169bdc0 with Priority: HIGH for action security_group_rules [ 1306.857527] env[69188]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 12570d95-0a4a-4579-82c8-53ecf65f714e with Priority: HIGH for action security_group_rules [ 1306.857819] env[69188]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9f2518e8-b195-4520-b262-caa765ab7e27 with Priority: HIGH for action security_group_rules [ 1306.857819] env[69188]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 143fbb10-efe2-4f17-a012-d41cc9b595b6 with Priority: HIGH for action security_group_rules [ 1306.857819] env[69188]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: cd207b0a-02a6-4378-9240-c9d49160b653 with Priority: HIGH for action security_group_rules [ 1306.857819] env[69188]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 938f39e5-b2c4-4a5d-b8ea-03c277953ec9 with Priority: HIGH for action security_group_rules [ 1306.857819] env[69188]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 53a4d3c3-01ca-4828-94d1-6fa305c27650 with Priority: HIGH for action security_group_rules [ 1306.857972] env[69188]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 048d5e2e-adfe-4bc0-9ae5-f6d99d633e62 with Priority: HIGH for action security_group_rules [ 1306.857972] env[69188]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 4c598260-71fe-43f5-ab89-63a95724ea23 with Priority: HIGH for action security_group_rules [ 1306.858038] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.227627] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f85bb0c6-bf80-4499-b5c3-0b4c4169bdc0',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1307.228674] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-f85bb0c6-bf80-4499-b5c3-0b4c4169bdc0 taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.229181] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f85bb0c6-bf80-4499-b5c3-0b4c4169bdc0" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.229488] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8d37fbe0-fdbc-4008-8c42-ec7afee8b2e6 with status ACTIVE [ 1307.230068] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.230068] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.230068] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.230068] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.230339] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.230339] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.230418] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.230450] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.230598] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.230675] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.230849] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.230939] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.230997] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.231147] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.231220] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.231301] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8d37fbe0-fdbc-4008-8c42-ec7afee8b2e6 is going to be updated. [ 1307.255825] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.255969] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.256049] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.256326] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.256487] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.256633] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8d37fbe0-fdbc-4008-8c42-ec7afee8b2e6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.388300] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1e2a81ad-1ea5-41c4-9fcb-b28a27366214 in Status: SUCCESS [ 1307.388567] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1e2a81ad-1ea5-41c4-9fcb-b28a27366214" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.730518] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f85bb0c6-bf80-4499-b5c3-0b4c4169bdc0',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1308.232705] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.232876] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.232982] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.233260] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.233422] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1308.233546] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f85bb0c6-bf80-4499-b5c3-0b4c4169bdc0 is going to be updated. [ 1308.264322] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.264519] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.264567] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.264835] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.265039] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1308.278518] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f85bb0c6-bf80-4499-b5c3-0b4c4169bdc0 in Status: IN_PROGRESS for 2s [ 1310.289682] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f85bb0c6-bf80-4499-b5c3-0b4c4169bdc0 in Status: SUCCESS [ 1310.290103] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f85bb0c6-bf80-4499-b5c3-0b4c4169bdc0" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.290103] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f85bb0c6-bf80-4499-b5c3-0b4c4169bdc0" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.290342] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f85bb0c6-bf80-4499-b5c3-0b4c4169bdc0" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.290551] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.290668] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.290734] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.290936] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.291039] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.291544] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f85bb0c6-bf80-4499-b5c3-0b4c4169bdc0" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.291544] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f85bb0c6-bf80-4499-b5c3-0b4c4169bdc0',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1310.793689] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f85bb0c6-bf80-4499-b5c3-0b4c4169bdc0',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1311.296616] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f85bb0c6-bf80-4499-b5c3-0b4c4169bdc0: rpc.has_security_group_logging(os_id): False [ 1311.314555] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.314767] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.314767] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.314969] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.333646] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.333942] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.334090] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.334175] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.334480] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.334623] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.334789] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f85bb0c6-bf80-4499-b5c3-0b4c4169bdc0 is going to be updated. [ 1311.391730] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.391976] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.392059] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.392235] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.392462] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.406485] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f85bb0c6-bf80-4499-b5c3-0b4c4169bdc0 in Status: IN_PROGRESS for 2s [ 1311.719284] env[69188]: INFO networking_nsxv3.common.synchronization [req-7892db85-9e2c-4b39-8f8e-08a5747d484f req-1e94f24b-84ff-4710-aaa9-b3fb007a4b8a tempest-ServerMetadataNegativeTestJSON-1276995623 tempest-ServerMetadataNegativeTestJSON-1276995623-project-member] Enqueued Resource ID: 1e2a81ad-1ea5-41c4-9fcb-b28a27366214 with Priority: HIGHEST for action security_group_members [ 1311.720171] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e2a81ad-1ea5-41c4-9fcb-b28a27366214 with Priority: HIGHEST for action security_group_members [ 1311.720171] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2240419a-b1eb-469c-b2f2-8c54a91fa4b9 with Priority: HIGH for action security_group_rules [ 1311.720171] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 397559b2-3c5a-424d-b09d-43a25d2abba6 with Priority: HIGH for action security_group_rules [ 1311.720171] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6551850f-c3f5-470f-b5eb-f7d542ab3a90 with Priority: HIGH for action security_group_rules [ 1311.720383] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 143fbb10-efe2-4f17-a012-d41cc9b595b6 with Priority: HIGH for action security_group_rules [ 1311.720383] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4c598260-71fe-43f5-ab89-63a95724ea23 with Priority: HIGH for action security_group_rules [ 1311.720456] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 048d5e2e-adfe-4bc0-9ae5-f6d99d633e62 with Priority: HIGH for action security_group_rules [ 1311.720497] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 53a4d3c3-01ca-4828-94d1-6fa305c27650 with Priority: HIGH for action security_group_rules [ 1311.720584] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 938f39e5-b2c4-4a5d-b8ea-03c277953ec9 with Priority: HIGH for action security_group_rules [ 1311.720670] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f2518e8-b195-4520-b262-caa765ab7e27 with Priority: HIGH for action security_group_rules [ 1311.720751] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cd207b0a-02a6-4378-9240-c9d49160b653 with Priority: HIGH for action security_group_rules [ 1311.720854] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 12570d95-0a4a-4579-82c8-53ecf65f714e with Priority: HIGH for action security_group_rules [ 1311.720916] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f85bb0c6-bf80-4499-b5c3-0b4c4169bdc0 with Priority: HIGH for action security_group_rules [ 1311.720997] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e2a81ad-1ea5-41c4-9fcb-b28a27366214 with Priority: HIGH for action security_group_rules [ 1311.724536] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fa6e8a6e-b63b-4248-b67b-4ae889fac90c with Priority: HIGH for action security_group_rules [ 1311.724536] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c7e4a274-48d0-4c86-9db6-5b72611db3e7 with Priority: HIGH for action security_group_rules [ 1311.724536] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0ba9367f-1279-4e82-9eaa-4519ee3a1efb with Priority: HIGH for action security_group_rules [ 1311.724536] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e3296f55-96ac-44eb-a498-8c6ab147c5ab with Priority: HIGH for action security_group_rules [ 1311.724536] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2fc127c1-64d5-4545-935d-5499e2e4234b with Priority: HIGH for action security_group_rules [ 1311.724536] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 199db626-eef5-4a20-b92a-585841c1cff4 with Priority: HIGH for action security_group_rules [ 1311.724536] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2a389e0c-0be3-41c9-986c-f4b06040a24d with Priority: HIGH for action security_group_rules [ 1311.724536] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e2a81ad-1ea5-41c4-9fcb-b28a27366214 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.724536] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e2a81ad-1ea5-41c4-9fcb-b28a27366214" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.724536] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e2a81ad-1ea5-41c4-9fcb-b28a27366214" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.724536] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e2a81ad-1ea5-41c4-9fcb-b28a27366214" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.724536] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.724536] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.724536] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.724536] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.724536] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.724536] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1e2a81ad-1ea5-41c4-9fcb-b28a27366214',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1311.724536] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2240419a-b1eb-469c-b2f2-8c54a91fa4b9 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.724536] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2240419a-b1eb-469c-b2f2-8c54a91fa4b9" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.724536] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2240419a-b1eb-469c-b2f2-8c54a91fa4b9" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.724536] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2240419a-b1eb-469c-b2f2-8c54a91fa4b9" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.725369] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2240419a-b1eb-469c-b2f2-8c54a91fa4b9',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1311.725369] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-397559b2-3c5a-424d-b09d-43a25d2abba6 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.725369] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-397559b2-3c5a-424d-b09d-43a25d2abba6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.725369] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-397559b2-3c5a-424d-b09d-43a25d2abba6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.725523] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-397559b2-3c5a-424d-b09d-43a25d2abba6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.725615] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('397559b2-3c5a-424d-b09d-43a25d2abba6',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1311.726269] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6551850f-c3f5-470f-b5eb-f7d542ab3a90 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.726392] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6551850f-c3f5-470f-b5eb-f7d542ab3a90" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.726441] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6551850f-c3f5-470f-b5eb-f7d542ab3a90" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.726565] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6551850f-c3f5-470f-b5eb-f7d542ab3a90" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.726623] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6551850f-c3f5-470f-b5eb-f7d542ab3a90',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1311.727312] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-143fbb10-efe2-4f17-a012-d41cc9b595b6 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.727418] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-143fbb10-efe2-4f17-a012-d41cc9b595b6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.727468] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-143fbb10-efe2-4f17-a012-d41cc9b595b6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.728026] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-143fbb10-efe2-4f17-a012-d41cc9b595b6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.728026] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('143fbb10-efe2-4f17-a012-d41cc9b595b6',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1311.728813] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4c598260-71fe-43f5-ab89-63a95724ea23 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.728907] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4c598260-71fe-43f5-ab89-63a95724ea23" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.728953] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4c598260-71fe-43f5-ab89-63a95724ea23" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.730031] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4c598260-71fe-43f5-ab89-63a95724ea23" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.730031] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4c598260-71fe-43f5-ab89-63a95724ea23',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1311.730031] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-048d5e2e-adfe-4bc0-9ae5-f6d99d633e62 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.730031] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-048d5e2e-adfe-4bc0-9ae5-f6d99d633e62" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.730031] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-048d5e2e-adfe-4bc0-9ae5-f6d99d633e62" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.730368] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-048d5e2e-adfe-4bc0-9ae5-f6d99d633e62" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.730368] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('048d5e2e-adfe-4bc0-9ae5-f6d99d633e62',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1311.730813] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-53a4d3c3-01ca-4828-94d1-6fa305c27650 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.730907] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-53a4d3c3-01ca-4828-94d1-6fa305c27650" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.731059] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-53a4d3c3-01ca-4828-94d1-6fa305c27650" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.731127] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-53a4d3c3-01ca-4828-94d1-6fa305c27650" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.731676] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('53a4d3c3-01ca-4828-94d1-6fa305c27650',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1311.732635] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-938f39e5-b2c4-4a5d-b8ea-03c277953ec9 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.732748] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-938f39e5-b2c4-4a5d-b8ea-03c277953ec9" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.732815] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-938f39e5-b2c4-4a5d-b8ea-03c277953ec9" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.732988] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-938f39e5-b2c4-4a5d-b8ea-03c277953ec9" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.733071] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('938f39e5-b2c4-4a5d-b8ea-03c277953ec9',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1311.734025] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9f2518e8-b195-4520-b262-caa765ab7e27 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.734113] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9f2518e8-b195-4520-b262-caa765ab7e27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.734157] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9f2518e8-b195-4520-b262-caa765ab7e27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.734402] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9f2518e8-b195-4520-b262-caa765ab7e27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.734402] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9f2518e8-b195-4520-b262-caa765ab7e27',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1311.735440] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cd207b0a-02a6-4378-9240-c9d49160b653 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.735440] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cd207b0a-02a6-4378-9240-c9d49160b653" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.735440] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cd207b0a-02a6-4378-9240-c9d49160b653" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.735568] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cd207b0a-02a6-4378-9240-c9d49160b653" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.735568] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cd207b0a-02a6-4378-9240-c9d49160b653',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1311.736186] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-12570d95-0a4a-4579-82c8-53ecf65f714e taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.736294] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-12570d95-0a4a-4579-82c8-53ecf65f714e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.736360] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-12570d95-0a4a-4579-82c8-53ecf65f714e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.736610] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-12570d95-0a4a-4579-82c8-53ecf65f714e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.736714] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('12570d95-0a4a-4579-82c8-53ecf65f714e',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1311.737593] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f85bb0c6-bf80-4499-b5c3-0b4c4169bdc0 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.737688] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f85bb0c6-bf80-4499-b5c3-0b4c4169bdc0" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.737798] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1e2a81ad-1ea5-41c4-9fcb-b28a27366214 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.738060] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1e2a81ad-1ea5-41c4-9fcb-b28a27366214" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.738131] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1e2a81ad-1ea5-41c4-9fcb-b28a27366214" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.738279] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1e2a81ad-1ea5-41c4-9fcb-b28a27366214" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.738527] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1e2a81ad-1ea5-41c4-9fcb-b28a27366214',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1311.739199] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fa6e8a6e-b63b-4248-b67b-4ae889fac90c taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.739309] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fa6e8a6e-b63b-4248-b67b-4ae889fac90c" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.739377] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fa6e8a6e-b63b-4248-b67b-4ae889fac90c" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.739524] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fa6e8a6e-b63b-4248-b67b-4ae889fac90c" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.739596] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fa6e8a6e-b63b-4248-b67b-4ae889fac90c',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1311.740522] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c7e4a274-48d0-4c86-9db6-5b72611db3e7 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.740633] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c7e4a274-48d0-4c86-9db6-5b72611db3e7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.740701] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c7e4a274-48d0-4c86-9db6-5b72611db3e7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.740855] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c7e4a274-48d0-4c86-9db6-5b72611db3e7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.740917] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c7e4a274-48d0-4c86-9db6-5b72611db3e7',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1311.741612] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0ba9367f-1279-4e82-9eaa-4519ee3a1efb taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.741762] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0ba9367f-1279-4e82-9eaa-4519ee3a1efb" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.741835] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0ba9367f-1279-4e82-9eaa-4519ee3a1efb" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.742110] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0ba9367f-1279-4e82-9eaa-4519ee3a1efb" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.742191] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0ba9367f-1279-4e82-9eaa-4519ee3a1efb',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1311.742838] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e3296f55-96ac-44eb-a498-8c6ab147c5ab taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.742959] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e3296f55-96ac-44eb-a498-8c6ab147c5ab" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.743039] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e3296f55-96ac-44eb-a498-8c6ab147c5ab" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.743191] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e3296f55-96ac-44eb-a498-8c6ab147c5ab" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.743263] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e3296f55-96ac-44eb-a498-8c6ab147c5ab',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1311.743903] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2fc127c1-64d5-4545-935d-5499e2e4234b taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.744084] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2fc127c1-64d5-4545-935d-5499e2e4234b" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.744157] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2fc127c1-64d5-4545-935d-5499e2e4234b" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.744307] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2fc127c1-64d5-4545-935d-5499e2e4234b" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.744379] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2fc127c1-64d5-4545-935d-5499e2e4234b',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1311.745354] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-199db626-eef5-4a20-b92a-585841c1cff4 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.745464] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-199db626-eef5-4a20-b92a-585841c1cff4" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.745530] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-199db626-eef5-4a20-b92a-585841c1cff4" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.745678] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-199db626-eef5-4a20-b92a-585841c1cff4" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.745750] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('199db626-eef5-4a20-b92a-585841c1cff4',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1311.746836] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2a389e0c-0be3-41c9-986c-f4b06040a24d taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.746945] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2a389e0c-0be3-41c9-986c-f4b06040a24d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.747021] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2a389e0c-0be3-41c9-986c-f4b06040a24d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.747173] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2a389e0c-0be3-41c9-986c-f4b06040a24d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.747239] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2a389e0c-0be3-41c9-986c-f4b06040a24d',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1312.249652] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-2fc127c1-64d5-4545-935d-5499e2e4234b taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1312.249809] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2fc127c1-64d5-4545-935d-5499e2e4234b" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1312.249882] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2fc127c1-64d5-4545-935d-5499e2e4234b" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1312.250137] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2fc127c1-64d5-4545-935d-5499e2e4234b" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1312.250303] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1312.250402] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1312.250459] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1312.250605] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1312.250694] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1312.250793] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2fc127c1-64d5-4545-935d-5499e2e4234b" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1312.250883] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2fc127c1-64d5-4545-935d-5499e2e4234b',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1312.262351] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1312.262556] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1312.262604] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1312.262785] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1312.305332] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1312.305772] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1312.327199] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1312.327317] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1312.332043] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1312.332043] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1312.332043] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1312.332043] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1312.332043] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1312.332043] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1312.332453] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1e2a81ad-1ea5-41c4-9fcb-b28a27366214 is going to be updated. [ 1312.333075] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1312.333263] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1312.334933] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1312.334933] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1312.335684] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1312.335793] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1312.336512] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1312.336621] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1312.337702] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1312.337852] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1312.338511] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1312.338593] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1312.339372] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1312.339520] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1312.340460] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1312.340581] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1312.341716] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1312.341848] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1312.342552] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1312.342656] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1312.343332] env[69188]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1312.343753] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1312.343870] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1312.344469] env[69188]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1312.344929] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1312.345048] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1312.345639] env[69188]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1312.346042] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1312.346167] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1312.350697] env[69188]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1312.351180] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1312.351278] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1312.354826] env[69188]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1312.355305] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1312.355425] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1312.356071] env[69188]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1312.356543] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1312.356659] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1312.365330] env[69188]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1312.365855] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1312.365964] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1312.369166] env[69188]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1312.369646] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1312.369798] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1312.369890] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1312.370153] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1312.370319] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1312.372021] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1312.372151] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 12570d95-0a4a-4579-82c8-53ecf65f714e is going to be deleted. [ 1312.373312] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1312.373514] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1312.390560] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1e2a81ad-1ea5-41c4-9fcb-b28a27366214 in Status: IN_PROGRESS for 2s [ 1312.401477] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1312.401620] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cd207b0a-02a6-4378-9240-c9d49160b653 is going to be deleted. [ 1312.402638] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1312.402862] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1312.403010] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1312.403126] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1e2a81ad-1ea5-41c4-9fcb-b28a27366214 is going to be deleted. [ 1312.403914] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1312.404121] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1312.428318] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1312.428538] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9f2518e8-b195-4520-b262-caa765ab7e27 is going to be deleted. [ 1312.429355] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1312.429574] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1312.486470] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1312.486636] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 397559b2-3c5a-424d-b09d-43a25d2abba6 is going to be deleted. [ 1312.487475] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1312.487684] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1312.490033] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1312.490209] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1312.491200] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1312.491342] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1312.504576] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1312.504790] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1312.519382] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1312.519556] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c7e4a274-48d0-4c86-9db6-5b72611db3e7 is going to be deleted. [ 1312.520380] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1312.520599] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1312.548517] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1312.548717] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fa6e8a6e-b63b-4248-b67b-4ae889fac90c is going to be deleted. [ 1312.549554] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1312.549769] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1312.566912] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1312.567126] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1312.571213] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1312.571341] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1312.616309] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1312.616497] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 938f39e5-b2c4-4a5d-b8ea-03c277953ec9 is going to be deleted. [ 1312.617380] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1312.617605] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1312.655647] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1312.655876] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1312.669290] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1312.669463] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e3296f55-96ac-44eb-a498-8c6ab147c5ab is going to be deleted. [ 1312.670442] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1312.670701] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1312.765039] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1312.765039] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6551850f-c3f5-470f-b5eb-f7d542ab3a90 is going to be deleted. [ 1312.765528] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1312.765783] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1312.770540] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2fc127c1-64d5-4545-935d-5499e2e4234b',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1312.857023] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1312.857199] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1312.866201] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1312.866400] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1312.898414] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1312.898613] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 199db626-eef5-4a20-b92a-585841c1cff4 is going to be deleted. [ 1312.899520] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1312.899750] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1312.957340] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1312.957574] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1312.964710] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1312.964858] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4c598260-71fe-43f5-ab89-63a95724ea23 is going to be deleted. [ 1312.965792] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1312.966031] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1313.016481] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.016664] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 53a4d3c3-01ca-4828-94d1-6fa305c27650 is going to be deleted. [ 1313.017630] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1313.017883] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1313.021124] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.021243] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.048157] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.048361] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.055560] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.055717] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2240419a-b1eb-469c-b2f2-8c54a91fa4b9 is going to be deleted. [ 1313.056604] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1313.056829] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1313.098787] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.098968] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2a389e0c-0be3-41c9-986c-f4b06040a24d is going to be deleted. [ 1313.099894] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1313.100148] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1313.154795] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.155017] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.177565] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.177565] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.200871] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.201098] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0ba9367f-1279-4e82-9eaa-4519ee3a1efb is going to be deleted. [ 1313.201936] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1313.202173] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1313.226543] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.226749] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.255755] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.256044] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 048d5e2e-adfe-4bc0-9ae5-f6d99d633e62 is going to be deleted. [ 1313.256859] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1313.257114] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1313.273958] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2fc127c1-64d5-4545-935d-5499e2e4234b: rpc.has_security_group_logging(os_id): False [ 1313.314626] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.315133] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.346697] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.346916] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.355290] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.355456] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 143fbb10-efe2-4f17-a012-d41cc9b595b6 is going to be deleted. [ 1313.356378] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1313.356595] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1313.356687] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.356808] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-12570d95-0a4a-4579-82c8-53ecf65f714e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.356965] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1313.357136] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1313.357219] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.357334] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cd207b0a-02a6-4378-9240-c9d49160b653" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.357850] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1313.358052] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1313.358142] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.358262] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1e2a81ad-1ea5-41c4-9fcb-b28a27366214" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.358392] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1313.358534] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1313.358611] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.358720] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9f2518e8-b195-4520-b262-caa765ab7e27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.358844] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1313.358980] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1313.359068] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.359184] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-397559b2-3c5a-424d-b09d-43a25d2abba6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.359312] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1313.359452] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1313.359526] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.359636] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c7e4a274-48d0-4c86-9db6-5b72611db3e7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.359776] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1313.359925] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1313.359998] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.360120] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fa6e8a6e-b63b-4248-b67b-4ae889fac90c" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.360244] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1313.360384] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1313.360458] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.360565] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-938f39e5-b2c4-4a5d-b8ea-03c277953ec9" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.360685] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1313.360822] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1313.360903] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.361038] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e3296f55-96ac-44eb-a498-8c6ab147c5ab" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.361199] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1313.361361] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1313.361441] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.361556] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6551850f-c3f5-470f-b5eb-f7d542ab3a90" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.361698] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1313.361840] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1313.361914] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.362034] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-199db626-eef5-4a20-b92a-585841c1cff4" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.362160] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1313.362298] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1313.362371] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.362478] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4c598260-71fe-43f5-ab89-63a95724ea23" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.362597] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1313.362732] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1313.362805] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.362935] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-53a4d3c3-01ca-4828-94d1-6fa305c27650" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.363114] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1313.363278] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1313.363356] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.363475] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2240419a-b1eb-469c-b2f2-8c54a91fa4b9" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.363597] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1313.363735] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1313.363811] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.363934] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2a389e0c-0be3-41c9-986c-f4b06040a24d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.364125] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1313.364275] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1313.376915] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.377123] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.419808] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.420047] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.425647] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.426048] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.426167] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.426236] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1313.426446] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1313.426531] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.426629] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2fc127c1-64d5-4545-935d-5499e2e4234b is going to be updated. [ 1313.427725] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1313.427904] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1313.427992] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.428121] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0ba9367f-1279-4e82-9eaa-4519ee3a1efb" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.428253] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1313.428430] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1313.428514] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.428629] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-048d5e2e-adfe-4bc0-9ae5-f6d99d633e62" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.440042] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f85bb0c6-bf80-4499-b5c3-0b4c4169bdc0 in Status: SUCCESS [ 1313.440267] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f85bb0c6-bf80-4499-b5c3-0b4c4169bdc0" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.440446] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f85bb0c6-bf80-4499-b5c3-0b4c4169bdc0" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1313.440658] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f85bb0c6-bf80-4499-b5c3-0b4c4169bdc0" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1313.440747] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f85bb0c6-bf80-4499-b5c3-0b4c4169bdc0',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1313.523770] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.524047] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.524047] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1313.524217] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1313.524327] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.524460] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-143fbb10-efe2-4f17-a012-d41cc9b595b6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.600112] env[69188]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1313.600702] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.600844] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.600930] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1313.601186] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1313.601331] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.630260] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2fc127c1-64d5-4545-935d-5499e2e4234b in Status: IN_PROGRESS for 2s [ 1313.943588] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-f85bb0c6-bf80-4499-b5c3-0b4c4169bdc0 taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.943736] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f85bb0c6-bf80-4499-b5c3-0b4c4169bdc0" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.943807] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f85bb0c6-bf80-4499-b5c3-0b4c4169bdc0" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1313.944112] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f85bb0c6-bf80-4499-b5c3-0b4c4169bdc0" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1313.944296] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.944410] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.944472] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1313.944643] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1313.944732] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.944819] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f85bb0c6-bf80-4499-b5c3-0b4c4169bdc0" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.944913] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f85bb0c6-bf80-4499-b5c3-0b4c4169bdc0',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1314.400369] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1e2a81ad-1ea5-41c4-9fcb-b28a27366214 in Status: SUCCESS [ 1314.400578] env[69188]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1e2a81ad-1ea5-41c4-9fcb-b28a27366214 deletion is rescheduled due to dependency. [ 1314.400709] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e2a81ad-1ea5-41c4-9fcb-b28a27366214" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1314.447180] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f85bb0c6-bf80-4499-b5c3-0b4c4169bdc0',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1314.949315] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f85bb0c6-bf80-4499-b5c3-0b4c4169bdc0: rpc.has_security_group_logging(os_id): False [ 1314.973369] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1314.973507] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1314.973575] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1314.973784] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1314.973885] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1314.975028] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1314.975028] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1314.975028] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1314.975028] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1314.975028] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1314.975028] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f85bb0c6-bf80-4499-b5c3-0b4c4169bdc0 is going to be updated. [ 1315.060567] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1315.060729] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1315.060804] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1315.061108] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1315.061266] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1315.076537] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f85bb0c6-bf80-4499-b5c3-0b4c4169bdc0 in Status: IN_PROGRESS for 2s [ 1315.645078] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2fc127c1-64d5-4545-935d-5499e2e4234b in Status: SUCCESS [ 1315.645456] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2fc127c1-64d5-4545-935d-5499e2e4234b" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1316.723168] env[69188]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1316.723529] env[69188]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1317.089063] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f85bb0c6-bf80-4499-b5c3-0b4c4169bdc0 in Status: SUCCESS [ 1317.089276] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f85bb0c6-bf80-4499-b5c3-0b4c4169bdc0" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1321.724767] env[69188]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1321.725146] env[69188]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1326.726016] env[69188]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1326.726332] env[69188]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1331.727075] env[69188]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1331.727429] env[69188]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1336.728322] env[69188]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1336.728322] env[69188]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1341.729706] env[69188]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1341.729997] env[69188]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1343.441615] env[69188]: INFO networking_nsxv3.common.synchronization [req-95fae238-db12-4cf3-834f-fe5e75c56f00 req-c9fb1f47-4ae7-4a25-82c3-fe8461785762 tempest-ServerActionsTestOtherA-1252171107 tempest-ServerActionsTestOtherA-1252171107-project-member] Enqueued Resource ID: 2c6aa97b-8577-4c5e-8b88-1678798f98a7 with Priority: HIGHEST for action security_group_members [ 1343.442216] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c6aa97b-8577-4c5e-8b88-1678798f98a7 with Priority: HIGHEST for action security_group_members [ 1343.442551] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-2c6aa97b-8577-4c5e-8b88-1678798f98a7 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1343.442682] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2c6aa97b-8577-4c5e-8b88-1678798f98a7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1343.442747] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2c6aa97b-8577-4c5e-8b88-1678798f98a7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1343.442997] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2c6aa97b-8577-4c5e-8b88-1678798f98a7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1343.443491] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1343.443633] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1343.443696] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1343.444147] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1343.444147] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1343.444147] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2c6aa97b-8577-4c5e-8b88-1678798f98a7',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1343.702826] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock network-657 taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1343.702826] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "network-657" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1343.703075] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "network-657" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1343.703191] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "network-657" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1343.703472] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1343.703649] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1343.703767] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1343.703978] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1343.704287] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1343.704510] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1343.704622] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] NeedRegenerationException {{(pid=69188) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1343.704800] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] no value, waiting for create lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1343.704855] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] value creation lock acquired {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1343.704937] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1343.705058] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Calling creation function for not-yet-present value {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1343.705194] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1343.726334] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1343.726493] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69188) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1343.726636] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Released creation lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1343.726800] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "network-657" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1343.727098] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock port-4c947ed6-a6a1-4f38-9c09-42dec7ca3a42 taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1343.727274] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "port-4c947ed6-a6a1-4f38-9c09-42dec7ca3a42" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1343.727430] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "port-4c947ed6-a6a1-4f38-9c09-42dec7ca3a42" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1343.727740] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "port-4c947ed6-a6a1-4f38-9c09-42dec7ca3a42" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1343.727884] env[69188]: DEBUG networking_nsxv3.api.rpc [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4c947ed6-a6a1-4f38-9c09-42dec7ca3a42',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1343.947048] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1343.947322] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1343.947322] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1343.947447] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1343.947535] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1343.947786] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1343.947881] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1343.947938] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1343.948116] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1343.948198] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1343.948284] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2c6aa97b-8577-4c5e-8b88-1678798f98a7 already deleted. [ 1343.948365] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2c6aa97b-8577-4c5e-8b88-1678798f98a7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1344.230311] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.230550] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.230682] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1344.230966] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1344.231141] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1344.231321] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Segment Port 4c947ed6-a6a1-4f38-9c09-42dec7ca3a42 not found, creating... [ 1344.231598] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.231795] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.231927] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1344.232171] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1344.232318] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1344.232606] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.232764] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.232886] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1344.233109] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1344.233252] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1344.233419] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Resource: SegmentPort with ID: 4c947ed6-a6a1-4f38-9c09-42dec7ca3a42 is going to be created. [ 1344.252426] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.252653] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.252723] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1344.252967] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1344.253209] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1344.253461] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "port-4c947ed6-a6a1-4f38-9c09-42dec7ca3a42" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1344.909130] env[69188]: INFO networking_nsxv3.common.synchronization [req-95fae238-db12-4cf3-834f-fe5e75c56f00 req-ad7a4dbb-5e82-40db-8b1d-612a6184149e service nova] Enqueued Resource ID: 2c6aa97b-8577-4c5e-8b88-1678798f98a7 with Priority: HIGHEST for action security_group_rules [ 1344.909130] env[69188]: INFO networking_nsxv3.common.synchronization [req-95fae238-db12-4cf3-834f-fe5e75c56f00 req-ad7a4dbb-5e82-40db-8b1d-612a6184149e service nova] Enqueued Resource ID: 2c6aa97b-8577-4c5e-8b88-1678798f98a7 with Priority: HIGHEST for action security_group_members [ 1344.909130] env[69188]: INFO networking_nsxv3.common.synchronization [req-95fae238-db12-4cf3-834f-fe5e75c56f00 req-ad7a4dbb-5e82-40db-8b1d-612a6184149e service nova] Enqueued Resource ID: 4c947ed6-a6a1-4f38-9c09-42dec7ca3a42 with Priority: HIGHEST for action port [ 1344.909130] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c6aa97b-8577-4c5e-8b88-1678798f98a7 with Priority: HIGHEST for action security_group_rules [ 1344.909130] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c6aa97b-8577-4c5e-8b88-1678798f98a7 with Priority: HIGHEST for action security_group_members [ 1344.909130] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4c947ed6-a6a1-4f38-9c09-42dec7ca3a42 with Priority: HIGHEST for action port [ 1344.909130] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2c6aa97b-8577-4c5e-8b88-1678798f98a7 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.909950] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2c6aa97b-8577-4c5e-8b88-1678798f98a7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.910273] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2c6aa97b-8577-4c5e-8b88-1678798f98a7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1344.911029] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2c6aa97b-8577-4c5e-8b88-1678798f98a7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1344.911029] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2c6aa97b-8577-4c5e-8b88-1678798f98a7',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1344.913547] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-2c6aa97b-8577-4c5e-8b88-1678798f98a7 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.913702] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2c6aa97b-8577-4c5e-8b88-1678798f98a7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.913789] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2c6aa97b-8577-4c5e-8b88-1678798f98a7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1344.913998] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2c6aa97b-8577-4c5e-8b88-1678798f98a7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1344.914262] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.914394] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.914475] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1344.914650] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1344.914755] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1344.914863] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2c6aa97b-8577-4c5e-8b88-1678798f98a7',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1344.916551] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-4c947ed6-a6a1-4f38-9c09-42dec7ca3a42 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.916665] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4c947ed6-a6a1-4f38-9c09-42dec7ca3a42" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.916736] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4c947ed6-a6a1-4f38-9c09-42dec7ca3a42" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1344.916882] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4c947ed6-a6a1-4f38-9c09-42dec7ca3a42" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1344.916993] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4c947ed6-a6a1-4f38-9c09-42dec7ca3a42',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1345.418859] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2c6aa97b-8577-4c5e-8b88-1678798f98a7',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1345.419908] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-2c6aa97b-8577-4c5e-8b88-1678798f98a7 taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1345.420036] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2c6aa97b-8577-4c5e-8b88-1678798f98a7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1345.420188] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4c947ed6-a6a1-4f38-9c09-42dec7ca3a42 with status ACTIVE [ 1345.420347] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1345.420455] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1345.420523] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1345.420717] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1345.420806] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1345.420972] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1345.421073] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1345.421133] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1345.421295] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1345.421368] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1345.421544] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1345.421638] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1345.421714] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1345.421819] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1345.421890] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1345.421969] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4c947ed6-a6a1-4f38-9c09-42dec7ca3a42 is going to be updated. [ 1345.443612] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1345.443761] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1345.443820] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1345.443996] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1345.444119] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1345.445042] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4c947ed6-a6a1-4f38-9c09-42dec7ca3a42" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1345.924999] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2c6aa97b-8577-4c5e-8b88-1678798f98a7',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1346.426929] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1346.427139] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1346.427238] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1346.427483] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1346.427590] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1346.427716] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2c6aa97b-8577-4c5e-8b88-1678798f98a7 is going to be created. [ 1346.454194] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1346.454365] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1346.454463] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1346.454669] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1346.454862] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1346.468428] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2c6aa97b-8577-4c5e-8b88-1678798f98a7 in Status: UNINITIALIZED for 2s [ 1348.479460] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2c6aa97b-8577-4c5e-8b88-1678798f98a7 in Status: SUCCESS [ 1348.479821] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2c6aa97b-8577-4c5e-8b88-1678798f98a7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1348.479821] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2c6aa97b-8577-4c5e-8b88-1678798f98a7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1348.480078] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2c6aa97b-8577-4c5e-8b88-1678798f98a7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1348.480278] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1348.480408] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1348.480473] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1348.480626] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1348.480710] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1348.480763] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2c6aa97b-8577-4c5e-8b88-1678798f98a7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1348.480885] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2c6aa97b-8577-4c5e-8b88-1678798f98a7',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1348.983314] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-2c6aa97b-8577-4c5e-8b88-1678798f98a7 taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1348.983647] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2c6aa97b-8577-4c5e-8b88-1678798f98a7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1348.983647] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2c6aa97b-8577-4c5e-8b88-1678798f98a7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1348.983738] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2c6aa97b-8577-4c5e-8b88-1678798f98a7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1348.983884] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1348.983978] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1348.984050] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1348.984198] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1348.984289] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1348.984377] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2c6aa97b-8577-4c5e-8b88-1678798f98a7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1348.984527] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-2c6aa97b-8577-4c5e-8b88-1678798f98a7 taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1348.984640] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2c6aa97b-8577-4c5e-8b88-1678798f98a7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1348.984711] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2c6aa97b-8577-4c5e-8b88-1678798f98a7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1348.984816] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2c6aa97b-8577-4c5e-8b88-1678798f98a7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1348.984949] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1348.985060] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1348.985115] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1348.985244] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1348.985320] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1348.985400] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2c6aa97b-8577-4c5e-8b88-1678798f98a7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1348.985489] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2c6aa97b-8577-4c5e-8b88-1678798f98a7',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1349.487777] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2c6aa97b-8577-4c5e-8b88-1678798f98a7: rpc.has_security_group_logging(os_id): False [ 1349.504873] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1349.505013] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1349.505095] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1349.505290] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1349.505378] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1349.505580] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1349.505677] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1349.505739] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1349.505893] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1349.505968] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1349.506153] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1349.506244] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1349.506306] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1349.506443] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1349.506517] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1349.506696] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1349.506785] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1349.506846] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1349.506978] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1349.507061] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1349.507161] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2c6aa97b-8577-4c5e-8b88-1678798f98a7 is going to be created. [ 1349.560647] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1349.560794] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1349.560840] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1349.560980] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1349.561161] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1349.570914] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2c6aa97b-8577-4c5e-8b88-1678798f98a7 in Status: IN_PROGRESS for 2s [ 1349.908943] env[69188]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1349.909157] env[69188]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1351.583376] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2c6aa97b-8577-4c5e-8b88-1678798f98a7 in Status: SUCCESS [ 1351.583802] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2c6aa97b-8577-4c5e-8b88-1678798f98a7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1354.910193] env[69188]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1354.910612] env[69188]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1359.448574] env[69188]: INFO networking_nsxv3.common.synchronization [req-d2a972c0-467c-42ee-a5ae-b5bee9e81b18 req-b0a0975c-9e05-497c-ab55-ae0ac77a3eb4 tempest-AttachVolumeShelveTestJSON-383073810 tempest-AttachVolumeShelveTestJSON-383073810-project-member] Enqueued Resource ID: f85bb0c6-bf80-4499-b5c3-0b4c4169bdc0 with Priority: HIGHEST for action security_group_members [ 1359.449116] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f85bb0c6-bf80-4499-b5c3-0b4c4169bdc0 with Priority: HIGHEST for action security_group_members [ 1359.449454] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-f85bb0c6-bf80-4499-b5c3-0b4c4169bdc0 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1359.449609] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f85bb0c6-bf80-4499-b5c3-0b4c4169bdc0" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1359.449703] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f85bb0c6-bf80-4499-b5c3-0b4c4169bdc0" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1359.449937] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f85bb0c6-bf80-4499-b5c3-0b4c4169bdc0" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1359.450112] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1359.450215] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1359.450276] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1359.450417] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1359.450502] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1359.450594] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f85bb0c6-bf80-4499-b5c3-0b4c4169bdc0',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1359.952819] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1359.952965] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1359.953057] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1359.953280] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1359.953379] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1359.953616] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1359.953717] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1359.953784] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1359.953932] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1359.954030] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1359.954120] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f85bb0c6-bf80-4499-b5c3-0b4c4169bdc0 is going to be updated. [ 1359.986970] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1359.987128] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1359.987176] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1359.987325] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1359.987455] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1360.001557] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f85bb0c6-bf80-4499-b5c3-0b4c4169bdc0 in Status: IN_PROGRESS for 2s [ 1362.012102] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f85bb0c6-bf80-4499-b5c3-0b4c4169bdc0 in Status: SUCCESS [ 1362.012456] env[69188]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f85bb0c6-bf80-4499-b5c3-0b4c4169bdc0 deletion is rescheduled due to dependency. [ 1362.012456] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f85bb0c6-bf80-4499-b5c3-0b4c4169bdc0" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1364.450557] env[69188]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1364.451053] env[69188]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1367.805613] env[69188]: INFO networking_nsxv3.common.synchronization [req-a5ac5e28-8809-48a9-b72d-a5594c358c4b req-a1ef1e73-bee8-4319-98f8-35412adb061a tempest-ServerActionsTestOtherA-1252171107 tempest-ServerActionsTestOtherA-1252171107-project-member] Enqueued Resource ID: 2c6aa97b-8577-4c5e-8b88-1678798f98a7 with Priority: HIGHEST for action security_group_members [ 1367.806150] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c6aa97b-8577-4c5e-8b88-1678798f98a7 with Priority: HIGHEST for action security_group_members [ 1367.806453] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-2c6aa97b-8577-4c5e-8b88-1678798f98a7 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1367.806574] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2c6aa97b-8577-4c5e-8b88-1678798f98a7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1367.806655] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2c6aa97b-8577-4c5e-8b88-1678798f98a7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1367.806869] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2c6aa97b-8577-4c5e-8b88-1678798f98a7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1367.807040] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1367.807142] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1367.807227] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1367.807385] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1367.807473] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1367.807579] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2c6aa97b-8577-4c5e-8b88-1678798f98a7',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1368.310191] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1368.310356] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1368.310438] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1368.310697] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1368.310785] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1368.310987] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1368.311099] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1368.311154] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1368.311307] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1368.311386] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1368.311475] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2c6aa97b-8577-4c5e-8b88-1678798f98a7 is going to be updated. [ 1368.337654] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1368.337777] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1368.337879] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1368.338035] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1368.338169] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1368.346167] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2c6aa97b-8577-4c5e-8b88-1678798f98a7 in Status: IN_PROGRESS for 2s [ 1370.357482] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2c6aa97b-8577-4c5e-8b88-1678798f98a7 in Status: SUCCESS [ 1370.357889] env[69188]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2c6aa97b-8577-4c5e-8b88-1678798f98a7 deletion is rescheduled due to dependency. [ 1370.357889] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2c6aa97b-8577-4c5e-8b88-1678798f98a7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1371.968426] env[69188]: INFO networking_nsxv3.common.synchronization [None req-f1353b4b-81fa-4c55-939b-0625befeabc8 tempest-ServerActionsTestOtherA-1252171107 tempest-ServerActionsTestOtherA-1252171107-project-member] Enqueued Resource ID: 22266528-0231-4142-81c2-081f9d6cd11d with Priority: HIGHEST for action security_group_rules [ 1371.968914] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 22266528-0231-4142-81c2-081f9d6cd11d with Priority: HIGHEST for action security_group_rules [ 1371.969234] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-22266528-0231-4142-81c2-081f9d6cd11d taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1371.969360] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-22266528-0231-4142-81c2-081f9d6cd11d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1371.969428] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-22266528-0231-4142-81c2-081f9d6cd11d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1371.969681] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-22266528-0231-4142-81c2-081f9d6cd11d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1371.969768] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('22266528-0231-4142-81c2-081f9d6cd11d',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1372.030582] env[69188]: INFO networking_nsxv3.common.synchronization [None req-15a36ed5-5180-4579-a0bf-9411000fcc11 tempest-ServerActionsTestOtherA-1252171107 tempest-ServerActionsTestOtherA-1252171107-project-member] Enqueued Resource ID: 22266528-0231-4142-81c2-081f9d6cd11d with Priority: HIGHEST for action security_group_rules [ 1372.031101] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 22266528-0231-4142-81c2-081f9d6cd11d with Priority: HIGHEST for action security_group_rules [ 1372.031419] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-22266528-0231-4142-81c2-081f9d6cd11d taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1372.031546] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-22266528-0231-4142-81c2-081f9d6cd11d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1372.490963] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1372.491159] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1372.491222] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1372.491405] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1372.491495] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1372.491605] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 22266528-0231-4142-81c2-081f9d6cd11d already deleted. [ 1372.491690] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-22266528-0231-4142-81c2-081f9d6cd11d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1372.491827] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-22266528-0231-4142-81c2-081f9d6cd11d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1372.491979] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-22266528-0231-4142-81c2-081f9d6cd11d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1372.492075] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('22266528-0231-4142-81c2-081f9d6cd11d',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1373.013228] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1373.013623] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1373.013623] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1373.013623] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1373.013759] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1373.013807] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 22266528-0231-4142-81c2-081f9d6cd11d already deleted. [ 1373.013883] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-22266528-0231-4142-81c2-081f9d6cd11d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1377.032432] env[69188]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1377.032734] env[69188]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1377.133196] env[69188]: INFO networking_nsxv3.common.synchronization [req-086b1ccd-244b-4682-b9bb-05f9f98d881c req-8ae18ced-1ddb-4706-90d7-59756a9b4e75 tempest-ServerActionsTestOtherA-1252171107 tempest-ServerActionsTestOtherA-1252171107-project-member] Enqueued Resource ID: 22266528-0231-4142-81c2-081f9d6cd11d with Priority: HIGHEST for action security_group_members [ 1377.134646] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 22266528-0231-4142-81c2-081f9d6cd11d with Priority: HIGHEST for action security_group_members [ 1377.135112] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-22266528-0231-4142-81c2-081f9d6cd11d taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1377.135308] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-22266528-0231-4142-81c2-081f9d6cd11d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1377.135431] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-22266528-0231-4142-81c2-081f9d6cd11d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1377.135845] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-22266528-0231-4142-81c2-081f9d6cd11d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1377.136100] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1377.136264] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1377.136358] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1377.136528] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1377.136621] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1377.136765] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('22266528-0231-4142-81c2-081f9d6cd11d',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1377.379321] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock network-657 taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1377.379529] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "network-657" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1377.379657] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "network-657" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1377.379943] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "network-657" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1377.380219] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1377.380380] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1377.380503] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1377.381199] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1377.381359] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1377.381597] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1377.381743] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] NeedRegenerationException {{(pid=69188) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1377.381967] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] no value, waiting for create lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1377.382130] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] value creation lock acquired {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1377.382255] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1377.382369] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Calling creation function for not-yet-present value {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1377.382508] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1377.403448] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1377.403633] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69188) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1377.403773] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Released creation lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1377.403948] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "network-657" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1377.404251] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock port-0449a472-36ff-4deb-afda-f9bb98369c0c taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1377.404416] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "port-0449a472-36ff-4deb-afda-f9bb98369c0c" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1377.404540] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "port-0449a472-36ff-4deb-afda-f9bb98369c0c" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1377.404864] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "port-0449a472-36ff-4deb-afda-f9bb98369c0c" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1377.405012] env[69188]: DEBUG networking_nsxv3.api.rpc [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0449a472-36ff-4deb-afda-f9bb98369c0c',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1377.639537] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1377.639747] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1377.639747] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1377.639905] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1377.639975] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1377.640195] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1377.640319] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1377.640379] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1377.640530] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1377.640609] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1377.640696] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 22266528-0231-4142-81c2-081f9d6cd11d already deleted. [ 1377.640775] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-22266528-0231-4142-81c2-081f9d6cd11d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1377.907767] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1377.908049] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1377.908161] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1377.908421] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1377.908575] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1377.908737] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Segment Port 0449a472-36ff-4deb-afda-f9bb98369c0c not found, creating... [ 1377.909011] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1377.909181] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1377.909306] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1377.909522] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1377.909664] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1377.909950] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1377.910119] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1377.910241] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1377.910447] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1377.910584] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1377.910727] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Resource: SegmentPort with ID: 0449a472-36ff-4deb-afda-f9bb98369c0c is going to be created. [ 1377.928600] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1377.928786] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1377.929156] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1377.929156] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1377.929354] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1377.929553] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "port-0449a472-36ff-4deb-afda-f9bb98369c0c" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1378.592513] env[69188]: INFO networking_nsxv3.common.synchronization [req-086b1ccd-244b-4682-b9bb-05f9f98d881c req-6889e78d-07c6-42df-986f-29a7b719e54c service nova] Enqueued Resource ID: 22266528-0231-4142-81c2-081f9d6cd11d with Priority: HIGHEST for action security_group_rules [ 1378.592754] env[69188]: INFO networking_nsxv3.common.synchronization [req-086b1ccd-244b-4682-b9bb-05f9f98d881c req-6889e78d-07c6-42df-986f-29a7b719e54c service nova] Enqueued Resource ID: 22266528-0231-4142-81c2-081f9d6cd11d with Priority: HIGHEST for action security_group_members [ 1378.592793] env[69188]: INFO networking_nsxv3.common.synchronization [req-086b1ccd-244b-4682-b9bb-05f9f98d881c req-6889e78d-07c6-42df-986f-29a7b719e54c service nova] Enqueued Resource ID: 0449a472-36ff-4deb-afda-f9bb98369c0c with Priority: HIGHEST for action port [ 1378.593009] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 22266528-0231-4142-81c2-081f9d6cd11d with Priority: HIGHEST for action security_group_rules [ 1378.593146] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 22266528-0231-4142-81c2-081f9d6cd11d with Priority: HIGHEST for action security_group_members [ 1378.593244] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0449a472-36ff-4deb-afda-f9bb98369c0c with Priority: HIGHEST for action port [ 1378.593797] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-22266528-0231-4142-81c2-081f9d6cd11d taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1378.593924] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-22266528-0231-4142-81c2-081f9d6cd11d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1378.594018] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-22266528-0231-4142-81c2-081f9d6cd11d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1378.594199] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-22266528-0231-4142-81c2-081f9d6cd11d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1378.594283] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('22266528-0231-4142-81c2-081f9d6cd11d',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1378.595227] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-22266528-0231-4142-81c2-081f9d6cd11d taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1378.595227] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-22266528-0231-4142-81c2-081f9d6cd11d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1378.595357] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-22266528-0231-4142-81c2-081f9d6cd11d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1378.595449] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-22266528-0231-4142-81c2-081f9d6cd11d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1378.595595] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1378.595688] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1378.595749] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1378.595888] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1378.595997] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1378.596072] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('22266528-0231-4142-81c2-081f9d6cd11d',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1378.596748] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-0449a472-36ff-4deb-afda-f9bb98369c0c taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1378.596846] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0449a472-36ff-4deb-afda-f9bb98369c0c" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1378.596918] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0449a472-36ff-4deb-afda-f9bb98369c0c" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1378.597070] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0449a472-36ff-4deb-afda-f9bb98369c0c" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1378.597143] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0449a472-36ff-4deb-afda-f9bb98369c0c',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1379.098467] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('22266528-0231-4142-81c2-081f9d6cd11d',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1379.099838] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-22266528-0231-4142-81c2-081f9d6cd11d taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1379.099838] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-22266528-0231-4142-81c2-081f9d6cd11d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1379.099838] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0449a472-36ff-4deb-afda-f9bb98369c0c with status ACTIVE [ 1379.099985] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1379.100067] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1379.100108] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1379.100304] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1379.100392] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1379.100562] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1379.100659] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1379.100716] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1379.100866] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1379.100944] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1379.101142] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1379.101243] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1379.101294] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1379.101424] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1379.101498] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1379.101611] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0449a472-36ff-4deb-afda-f9bb98369c0c is going to be updated. [ 1379.121085] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1379.121085] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1379.121085] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1379.121085] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1379.121323] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1379.121396] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0449a472-36ff-4deb-afda-f9bb98369c0c" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1379.604015] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('22266528-0231-4142-81c2-081f9d6cd11d',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1380.106717] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1380.106954] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1380.106954] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1380.107180] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1380.107273] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1380.107372] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 22266528-0231-4142-81c2-081f9d6cd11d is going to be created. [ 1380.128534] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1380.128676] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1380.128722] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1380.128900] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1380.129065] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1380.137108] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 22266528-0231-4142-81c2-081f9d6cd11d in Status: UNINITIALIZED for 2s [ 1382.147623] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 22266528-0231-4142-81c2-081f9d6cd11d in Status: SUCCESS [ 1382.148019] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-22266528-0231-4142-81c2-081f9d6cd11d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1382.148019] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-22266528-0231-4142-81c2-081f9d6cd11d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1382.148236] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-22266528-0231-4142-81c2-081f9d6cd11d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1382.148428] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1382.148545] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1382.148607] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1382.148780] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1382.148860] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1382.148946] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-22266528-0231-4142-81c2-081f9d6cd11d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1382.149047] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('22266528-0231-4142-81c2-081f9d6cd11d',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1382.651495] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('22266528-0231-4142-81c2-081f9d6cd11d',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1383.153839] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 22266528-0231-4142-81c2-081f9d6cd11d: rpc.has_security_group_logging(os_id): False [ 1383.172712] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1383.172894] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1383.172894] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1383.173117] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1383.173274] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1383.173434] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1383.173540] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1383.173579] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1383.173787] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1383.173864] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1383.173945] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 22266528-0231-4142-81c2-081f9d6cd11d is going to be created. [ 1383.257347] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1383.257510] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1383.257553] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1383.257750] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1383.257931] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1383.269935] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 22266528-0231-4142-81c2-081f9d6cd11d in Status: IN_PROGRESS for 2s [ 1383.593945] env[69188]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1383.594113] env[69188]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1385.283070] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 22266528-0231-4142-81c2-081f9d6cd11d in Status: SUCCESS [ 1385.283504] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-22266528-0231-4142-81c2-081f9d6cd11d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1388.594769] env[69188]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1388.595179] env[69188]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1393.595992] env[69188]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1393.596428] env[69188]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1398.596989] env[69188]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1398.597559] env[69188]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1403.598634] env[69188]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1403.599109] env[69188]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1408.599488] env[69188]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1408.599923] env[69188]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1413.601059] env[69188]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1413.601059] env[69188]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1418.602248] env[69188]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1418.602657] env[69188]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1423.603808] env[69188]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1423.603808] env[69188]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1428.604370] env[69188]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1428.604706] env[69188]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1433.605596] env[69188]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1433.605877] env[69188]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1438.606692] env[69188]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1438.607066] env[69188]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1443.607365] env[69188]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1443.607736] env[69188]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1448.608269] env[69188]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1448.608741] env[69188]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1453.609478] env[69188]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1453.609872] env[69188]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1458.610878] env[69188]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1458.611324] env[69188]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1463.612044] env[69188]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1463.612044] env[69188]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1468.613368] env[69188]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1468.613368] env[69188]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1473.613831] env[69188]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1473.614290] env[69188]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1478.615374] env[69188]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1478.615718] env[69188]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1483.616388] env[69188]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1483.616818] env[69188]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1488.617340] env[69188]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1488.617692] env[69188]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1489.028203] env[69188]: INFO networking_nsxv3.common.synchronization [req-fdef07d8-d71c-438f-9c78-8f5ea1556f39 req-c58aae62-afe5-44a2-bf9c-1af69edb99a9 tempest-ServerActionsTestOtherA-1252171107 tempest-ServerActionsTestOtherA-1252171107-project-member] Enqueued Resource ID: 22266528-0231-4142-81c2-081f9d6cd11d with Priority: HIGHEST for action security_group_members [ 1489.028822] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 22266528-0231-4142-81c2-081f9d6cd11d with Priority: HIGHEST for action security_group_members [ 1489.029202] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-22266528-0231-4142-81c2-081f9d6cd11d taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1489.029362] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-22266528-0231-4142-81c2-081f9d6cd11d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1489.029447] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-22266528-0231-4142-81c2-081f9d6cd11d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1489.029713] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-22266528-0231-4142-81c2-081f9d6cd11d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1489.029886] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1489.030037] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1489.030129] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1489.030325] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1489.030447] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1489.030566] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('22266528-0231-4142-81c2-081f9d6cd11d',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1489.532529] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1489.532728] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1489.532791] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1489.533014] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1489.533111] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1489.533309] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1489.533411] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1489.533472] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1489.533607] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1489.533683] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1489.533769] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 22266528-0231-4142-81c2-081f9d6cd11d is going to be updated. [ 1489.566679] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1489.566849] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1489.566849] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1489.567032] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1489.567178] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1489.574099] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 22266528-0231-4142-81c2-081f9d6cd11d in Status: IN_PROGRESS for 2s [ 1491.585403] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 22266528-0231-4142-81c2-081f9d6cd11d in Status: SUCCESS [ 1491.585825] env[69188]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 22266528-0231-4142-81c2-081f9d6cd11d deletion is rescheduled due to dependency. [ 1491.585825] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-22266528-0231-4142-81c2-081f9d6cd11d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1494.030241] env[69188]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1494.030562] env[69188]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1498.341199] env[69188]: INFO networking_nsxv3.common.synchronization [req-629205a0-6368-4843-b3dd-525be16c0761 req-3f2e3242-ff17-4b01-ba80-39535c6f2386 tempest-ServerActionsTestOtherA-1252171107 tempest-ServerActionsTestOtherA-1252171107-project-member] Enqueued Resource ID: 2c6aa97b-8577-4c5e-8b88-1678798f98a7 with Priority: HIGHEST for action security_group_members [ 1498.341504] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c6aa97b-8577-4c5e-8b88-1678798f98a7 with Priority: HIGHEST for action security_group_members [ 1498.341660] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-2c6aa97b-8577-4c5e-8b88-1678798f98a7 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1498.341783] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2c6aa97b-8577-4c5e-8b88-1678798f98a7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1498.341849] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2c6aa97b-8577-4c5e-8b88-1678798f98a7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1498.342121] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2c6aa97b-8577-4c5e-8b88-1678798f98a7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1498.342287] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1498.342388] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1498.342444] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1498.342630] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1498.342698] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1498.342774] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2c6aa97b-8577-4c5e-8b88-1678798f98a7',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1498.612933] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock network-657 taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1498.613158] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "network-657" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1498.613290] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "network-657" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1498.613556] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "network-657" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1498.613819] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1498.613981] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1498.614116] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1498.614324] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1498.614473] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1498.614683] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1498.614798] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] NeedRegenerationException {{(pid=69188) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1498.614947] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] no value, waiting for create lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1498.615084] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] value creation lock acquired {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1498.615200] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1498.615312] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Calling creation function for not-yet-present value {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1498.615446] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1498.634867] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1498.635041] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69188) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1498.635181] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Released creation lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1498.635360] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "network-657" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1498.635645] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock port-f12348e7-aa1d-42fe-be6a-413e3d64e16c taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1498.635812] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "port-f12348e7-aa1d-42fe-be6a-413e3d64e16c" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1498.635960] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "port-f12348e7-aa1d-42fe-be6a-413e3d64e16c" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1498.636271] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "port-f12348e7-aa1d-42fe-be6a-413e3d64e16c" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1498.636414] env[69188]: DEBUG networking_nsxv3.api.rpc [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f12348e7-aa1d-42fe-be6a-413e3d64e16c',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1498.844885] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1498.845090] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1498.845090] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1498.845295] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1498.845387] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1498.845578] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1498.845677] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1498.845736] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1498.845901] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1498.845977] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1498.846075] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2c6aa97b-8577-4c5e-8b88-1678798f98a7 is going to be updated. [ 1498.874271] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1498.874469] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1498.874469] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1498.874607] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1498.874735] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1498.885713] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2c6aa97b-8577-4c5e-8b88-1678798f98a7 in Status: IN_PROGRESS for 2s [ 1499.138243] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1499.138708] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1499.138708] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1499.138873] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1499.138988] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1499.139163] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Segment Port f12348e7-aa1d-42fe-be6a-413e3d64e16c not found, creating... [ 1499.139424] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1499.139584] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1499.139718] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1499.140011] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1499.140205] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1499.140502] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1499.140672] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1499.140870] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1499.141156] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1499.141303] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1499.141446] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Resource: SegmentPort with ID: f12348e7-aa1d-42fe-be6a-413e3d64e16c is going to be created. [ 1499.159222] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1499.159420] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1499.159569] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1499.159789] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1499.160016] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1499.160243] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "port-f12348e7-aa1d-42fe-be6a-413e3d64e16c" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1499.841599] env[69188]: INFO networking_nsxv3.common.synchronization [req-629205a0-6368-4843-b3dd-525be16c0761 req-5a86d93e-475c-4b49-93dc-825ef01086cf service nova] Enqueued Resource ID: 2c6aa97b-8577-4c5e-8b88-1678798f98a7 with Priority: HIGHEST for action security_group_rules [ 1499.841929] env[69188]: INFO networking_nsxv3.common.synchronization [req-629205a0-6368-4843-b3dd-525be16c0761 req-5a86d93e-475c-4b49-93dc-825ef01086cf service nova] Enqueued Resource ID: 2c6aa97b-8577-4c5e-8b88-1678798f98a7 with Priority: HIGHEST for action security_group_members [ 1499.842204] env[69188]: INFO networking_nsxv3.common.synchronization [req-629205a0-6368-4843-b3dd-525be16c0761 req-5a86d93e-475c-4b49-93dc-825ef01086cf service nova] Enqueued Resource ID: f12348e7-aa1d-42fe-be6a-413e3d64e16c with Priority: HIGHEST for action port [ 1499.842907] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c6aa97b-8577-4c5e-8b88-1678798f98a7 with Priority: HIGHEST for action security_group_rules [ 1499.843145] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c6aa97b-8577-4c5e-8b88-1678798f98a7 with Priority: HIGHEST for action security_group_members [ 1499.843312] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f12348e7-aa1d-42fe-be6a-413e3d64e16c with Priority: HIGHEST for action port [ 1499.843711] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2c6aa97b-8577-4c5e-8b88-1678798f98a7 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1499.843902] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2c6aa97b-8577-4c5e-8b88-1678798f98a7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1499.844035] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2c6aa97b-8577-4c5e-8b88-1678798f98a7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1499.844334] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2c6aa97b-8577-4c5e-8b88-1678798f98a7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1499.844468] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2c6aa97b-8577-4c5e-8b88-1678798f98a7',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1499.845597] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-2c6aa97b-8577-4c5e-8b88-1678798f98a7 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1499.845742] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2c6aa97b-8577-4c5e-8b88-1678798f98a7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1499.846047] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-f12348e7-aa1d-42fe-be6a-413e3d64e16c taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1499.846208] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f12348e7-aa1d-42fe-be6a-413e3d64e16c" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1499.846286] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f12348e7-aa1d-42fe-be6a-413e3d64e16c" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1499.846494] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f12348e7-aa1d-42fe-be6a-413e3d64e16c" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1499.846581] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f12348e7-aa1d-42fe-be6a-413e3d64e16c',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1500.349222] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-2c6aa97b-8577-4c5e-8b88-1678798f98a7 taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1500.349426] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2c6aa97b-8577-4c5e-8b88-1678798f98a7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1500.349506] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f12348e7-aa1d-42fe-be6a-413e3d64e16c with status ACTIVE [ 1500.349654] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1500.349757] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1500.349817] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1500.350065] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1500.350145] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1500.350286] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1500.350408] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1500.350448] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1500.350582] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1500.350664] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1500.350832] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1500.350934] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1500.350986] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1500.351147] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1500.351223] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1500.351302] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f12348e7-aa1d-42fe-be6a-413e3d64e16c is going to be updated. [ 1500.370138] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1500.370290] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1500.370355] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1500.370466] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1500.370588] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1500.370727] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f12348e7-aa1d-42fe-be6a-413e3d64e16c" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1500.893860] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2c6aa97b-8577-4c5e-8b88-1678798f98a7 in Status: SUCCESS [ 1500.894155] env[69188]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2c6aa97b-8577-4c5e-8b88-1678798f98a7 deletion is rescheduled due to dependency. [ 1500.894155] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2c6aa97b-8577-4c5e-8b88-1678798f98a7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1500.894313] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2c6aa97b-8577-4c5e-8b88-1678798f98a7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1500.894514] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2c6aa97b-8577-4c5e-8b88-1678798f98a7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1500.894694] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1500.894809] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1500.894890] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1500.895054] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1500.895139] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1500.895231] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2c6aa97b-8577-4c5e-8b88-1678798f98a7',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1501.398933] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2c6aa97b-8577-4c5e-8b88-1678798f98a7',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1501.902035] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2c6aa97b-8577-4c5e-8b88-1678798f98a7',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1502.403787] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1502.403958] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1502.404044] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1502.404251] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1502.404347] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1502.404448] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2c6aa97b-8577-4c5e-8b88-1678798f98a7 is going to be updated. [ 1502.431051] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1502.431051] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1502.431051] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1502.431289] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1502.431289] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1502.438458] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2c6aa97b-8577-4c5e-8b88-1678798f98a7 in Status: IN_PROGRESS for 2s [ 1504.448629] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2c6aa97b-8577-4c5e-8b88-1678798f98a7 in Status: SUCCESS [ 1504.448959] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2c6aa97b-8577-4c5e-8b88-1678798f98a7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1504.449034] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2c6aa97b-8577-4c5e-8b88-1678798f98a7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1504.449217] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2c6aa97b-8577-4c5e-8b88-1678798f98a7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1504.449404] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1504.449518] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1504.449579] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1504.449731] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1504.449814] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1504.449901] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2c6aa97b-8577-4c5e-8b88-1678798f98a7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1504.449992] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2c6aa97b-8577-4c5e-8b88-1678798f98a7',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1504.844958] env[69188]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1504.845178] env[69188]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1504.952931] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-2c6aa97b-8577-4c5e-8b88-1678798f98a7 taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1504.953211] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2c6aa97b-8577-4c5e-8b88-1678798f98a7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1504.953211] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2c6aa97b-8577-4c5e-8b88-1678798f98a7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1504.953384] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2c6aa97b-8577-4c5e-8b88-1678798f98a7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1504.953556] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1504.953656] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1504.953711] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1504.953856] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1504.953946] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1504.954049] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2c6aa97b-8577-4c5e-8b88-1678798f98a7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1504.954198] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-2c6aa97b-8577-4c5e-8b88-1678798f98a7 taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1504.954292] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2c6aa97b-8577-4c5e-8b88-1678798f98a7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1504.954343] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2c6aa97b-8577-4c5e-8b88-1678798f98a7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1504.954478] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2c6aa97b-8577-4c5e-8b88-1678798f98a7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1504.954613] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1504.954704] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1504.954760] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1504.954955] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1504.955032] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1504.955106] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2c6aa97b-8577-4c5e-8b88-1678798f98a7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1504.955194] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2c6aa97b-8577-4c5e-8b88-1678798f98a7',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1505.458071] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2c6aa97b-8577-4c5e-8b88-1678798f98a7: rpc.has_security_group_logging(os_id): False [ 1505.475309] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1505.475508] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1505.475555] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1505.475768] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1505.475871] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1505.476129] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1505.476280] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1505.476343] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1505.476477] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1505.476574] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1505.476764] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1505.476871] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1505.476932] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1505.477118] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1505.477232] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1505.477408] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1505.477526] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1505.477592] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1505.477750] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1505.477830] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1505.477917] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2c6aa97b-8577-4c5e-8b88-1678798f98a7 is going to be updated. [ 1505.536204] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1505.536365] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1505.536422] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1505.536601] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1505.536745] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1505.549077] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2c6aa97b-8577-4c5e-8b88-1678798f98a7 in Status: IN_PROGRESS for 2s [ 1507.192706] env[69188]: INFO networking_nsxv3.common.synchronization [req-99ecfa60-8a1b-4b32-aa92-d3bd5134cc8f req-ac30f9be-182a-438e-8436-6a5e572f90f3 tempest-ServerActionsTestOtherA-1252171107 tempest-ServerActionsTestOtherA-1252171107-project-member] Enqueued Resource ID: 2c6aa97b-8577-4c5e-8b88-1678798f98a7 with Priority: HIGHEST for action security_group_members [ 1507.193337] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c6aa97b-8577-4c5e-8b88-1678798f98a7 with Priority: HIGHEST for action security_group_members [ 1507.194023] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-2c6aa97b-8577-4c5e-8b88-1678798f98a7 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1507.194151] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2c6aa97b-8577-4c5e-8b88-1678798f98a7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1507.194222] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2c6aa97b-8577-4c5e-8b88-1678798f98a7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1507.194415] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2c6aa97b-8577-4c5e-8b88-1678798f98a7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1507.194568] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1507.194660] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1507.194725] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1507.194864] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1507.194990] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1507.195096] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2c6aa97b-8577-4c5e-8b88-1678798f98a7',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1507.231247] env[69188]: INFO networking_nsxv3.common.synchronization [req-99ecfa60-8a1b-4b32-aa92-d3bd5134cc8f req-ac30f9be-182a-438e-8436-6a5e572f90f3 tempest-ServerActionsTestOtherA-1252171107 tempest-ServerActionsTestOtherA-1252171107-project-member] Enqueued Resource ID: f12348e7-aa1d-42fe-be6a-413e3d64e16c with Priority: HIGHEST for action port [ 1507.231499] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f12348e7-aa1d-42fe-be6a-413e3d64e16c with Priority: HIGHEST for action port [ 1507.231978] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-f12348e7-aa1d-42fe-be6a-413e3d64e16c taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1507.232166] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f12348e7-aa1d-42fe-be6a-413e3d64e16c" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1507.232245] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f12348e7-aa1d-42fe-be6a-413e3d64e16c" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1507.232423] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f12348e7-aa1d-42fe-be6a-413e3d64e16c" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1507.232506] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f12348e7-aa1d-42fe-be6a-413e3d64e16c',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1507.563587] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2c6aa97b-8577-4c5e-8b88-1678798f98a7 in Status: SUCCESS [ 1507.563829] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2c6aa97b-8577-4c5e-8b88-1678798f98a7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1507.696762] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1507.696921] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1507.696997] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1507.697249] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1507.697355] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1507.697585] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1507.697742] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1507.697816] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1507.697986] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1507.698082] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1507.698174] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2c6aa97b-8577-4c5e-8b88-1678798f98a7 is going to be updated. [ 1507.725036] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1507.725188] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1507.725258] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1507.725458] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1507.725592] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1507.734082] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2c6aa97b-8577-4c5e-8b88-1678798f98a7 in Status: IN_PROGRESS for 2s [ 1507.734583] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f12348e7-aa1d-42fe-be6a-413e3d64e16c with status ACTIVE [ 1507.734583] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1507.734690] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1507.734736] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1507.734941] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1507.735051] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1507.735230] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1507.735329] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1507.735389] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1507.735538] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1507.735615] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1507.735795] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1507.735889] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1507.735973] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1507.736167] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1507.736245] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1507.736331] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f12348e7-aa1d-42fe-be6a-413e3d64e16c is going to be updated. [ 1507.753532] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1507.753650] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1507.753726] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1507.753883] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1507.754013] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1507.754182] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f12348e7-aa1d-42fe-be6a-413e3d64e16c" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1509.745558] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2c6aa97b-8577-4c5e-8b88-1678798f98a7 in Status: SUCCESS [ 1509.745995] env[69188]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2c6aa97b-8577-4c5e-8b88-1678798f98a7 deletion is rescheduled due to dependency. [ 1509.745995] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2c6aa97b-8577-4c5e-8b88-1678798f98a7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1512.232734] env[69188]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1512.233143] env[69188]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1517.234492] env[69188]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1517.234492] env[69188]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1520.213377] env[69188]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-ca0141f8-e0d0-45bb-94d3-6579b85b932c None None] NSXv3 Agent Agent loop - iteration:3 completed [ 1520.213712] env[69188]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-ca0141f8-e0d0-45bb-94d3-6579b85b932c None None] NSXv3 Agent Agent loop - iteration:4 started [ 1522.235499] env[69188]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1522.235814] env[69188]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1527.236771] env[69188]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1527.237212] env[69188]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1530.473135] env[69188]: INFO networking_nsxv3.common.synchronization [req-e784a867-b3eb-40bd-945c-fdba859cbb9c req-da1a1a7b-7e9b-47f3-ab4a-bbc9aab09369 tempest-ServerActionsTestOtherA-1252171107 tempest-ServerActionsTestOtherA-1252171107-project-member] Enqueued Resource ID: 2fc127c1-64d5-4545-935d-5499e2e4234b with Priority: HIGHEST for action security_group_members [ 1530.475016] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2fc127c1-64d5-4545-935d-5499e2e4234b with Priority: HIGHEST for action security_group_members [ 1530.475016] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-2fc127c1-64d5-4545-935d-5499e2e4234b taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1530.475016] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2fc127c1-64d5-4545-935d-5499e2e4234b" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1530.475388] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2fc127c1-64d5-4545-935d-5499e2e4234b" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1530.475814] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2fc127c1-64d5-4545-935d-5499e2e4234b" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1530.477507] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1530.477507] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1530.477507] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1530.477507] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1530.477507] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1530.477507] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2fc127c1-64d5-4545-935d-5499e2e4234b',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1530.756325] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock network-657 taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1530.756580] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "network-657" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1530.756748] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "network-657" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1530.757061] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "network-657" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1530.757364] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1530.757568] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1530.757727] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1530.757978] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1530.758215] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1530.758476] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1530.758631] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] NeedRegenerationException {{(pid=69188) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1530.758782] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] no value, waiting for create lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1530.758933] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] value creation lock acquired {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1530.759107] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1530.759266] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Calling creation function for not-yet-present value {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1530.759441] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1530.777655] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1530.777800] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69188) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1530.777934] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Released creation lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1530.778112] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "network-657" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1530.778383] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock port-81234d6e-4792-4825-b6ac-008cf6bc249c taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1530.778546] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "port-81234d6e-4792-4825-b6ac-008cf6bc249c" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1530.778669] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "port-81234d6e-4792-4825-b6ac-008cf6bc249c" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1530.778958] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "port-81234d6e-4792-4825-b6ac-008cf6bc249c" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1530.779116] env[69188]: DEBUG networking_nsxv3.api.rpc [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('81234d6e-4792-4825-b6ac-008cf6bc249c',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1530.979414] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2fc127c1-64d5-4545-935d-5499e2e4234b',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1531.281662] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1531.281981] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1531.282125] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1531.282425] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1531.282646] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1531.282816] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Segment Port 81234d6e-4792-4825-b6ac-008cf6bc249c not found, creating... [ 1531.283112] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1531.283279] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1531.283402] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1531.283628] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1531.283769] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1531.284058] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1531.284247] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1531.284375] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1531.284599] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1531.284758] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1531.284903] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Resource: SegmentPort with ID: 81234d6e-4792-4825-b6ac-008cf6bc249c is going to be created. [ 1531.305973] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1531.306177] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1531.306311] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1531.306535] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1531.306748] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1531.306952] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "port-81234d6e-4792-4825-b6ac-008cf6bc249c" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1531.481468] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2fc127c1-64d5-4545-935d-5499e2e4234b',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1531.972319] env[69188]: INFO networking_nsxv3.common.synchronization [req-e784a867-b3eb-40bd-945c-fdba859cbb9c req-ef1b4273-16b1-4c4c-82b8-fcd88bd9276e service nova] Enqueued Resource ID: 2fc127c1-64d5-4545-935d-5499e2e4234b with Priority: HIGHEST for action security_group_rules [ 1531.972499] env[69188]: INFO networking_nsxv3.common.synchronization [req-e784a867-b3eb-40bd-945c-fdba859cbb9c req-ef1b4273-16b1-4c4c-82b8-fcd88bd9276e service nova] Enqueued Resource ID: 2fc127c1-64d5-4545-935d-5499e2e4234b with Priority: HIGHEST for action security_group_members [ 1531.972691] env[69188]: INFO networking_nsxv3.common.synchronization [req-e784a867-b3eb-40bd-945c-fdba859cbb9c req-ef1b4273-16b1-4c4c-82b8-fcd88bd9276e service nova] Enqueued Resource ID: 81234d6e-4792-4825-b6ac-008cf6bc249c with Priority: HIGHEST for action port [ 1531.972861] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2fc127c1-64d5-4545-935d-5499e2e4234b with Priority: HIGHEST for action security_group_rules [ 1531.972985] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2fc127c1-64d5-4545-935d-5499e2e4234b with Priority: HIGHEST for action security_group_members [ 1531.973100] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 81234d6e-4792-4825-b6ac-008cf6bc249c with Priority: HIGHEST for action port [ 1531.973633] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2fc127c1-64d5-4545-935d-5499e2e4234b taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1531.973756] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2fc127c1-64d5-4545-935d-5499e2e4234b" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1531.973823] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2fc127c1-64d5-4545-935d-5499e2e4234b" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1531.974048] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2fc127c1-64d5-4545-935d-5499e2e4234b" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1531.974137] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2fc127c1-64d5-4545-935d-5499e2e4234b',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1531.974953] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-2fc127c1-64d5-4545-935d-5499e2e4234b taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1531.976029] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2fc127c1-64d5-4545-935d-5499e2e4234b" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1531.976029] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-81234d6e-4792-4825-b6ac-008cf6bc249c taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1531.976029] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-81234d6e-4792-4825-b6ac-008cf6bc249c" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1531.976029] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-81234d6e-4792-4825-b6ac-008cf6bc249c" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1531.976029] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-81234d6e-4792-4825-b6ac-008cf6bc249c" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1531.976029] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('81234d6e-4792-4825-b6ac-008cf6bc249c',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1531.983326] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1531.983458] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1531.983515] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1531.984443] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1531.984443] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1531.984443] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2fc127c1-64d5-4545-935d-5499e2e4234b is going to be updated. [ 1532.016247] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1532.016389] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1532.016458] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1532.016633] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1532.016782] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1532.024795] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2fc127c1-64d5-4545-935d-5499e2e4234b in Status: IN_PROGRESS for 2s [ 1532.477906] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-2fc127c1-64d5-4545-935d-5499e2e4234b taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1532.478193] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2fc127c1-64d5-4545-935d-5499e2e4234b" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1532.479321] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 81234d6e-4792-4825-b6ac-008cf6bc249c with status ACTIVE [ 1532.479508] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1532.479624] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1532.479689] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1532.479906] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1532.479995] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1532.480185] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1532.480285] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1532.480413] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1532.480496] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1532.480566] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1532.480742] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1532.480832] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1532.480889] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1532.481035] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1532.481111] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1532.481217] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 81234d6e-4792-4825-b6ac-008cf6bc249c is going to be updated. [ 1532.500552] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1532.500852] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1532.500852] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1532.500929] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1532.501026] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1532.501180] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-81234d6e-4792-4825-b6ac-008cf6bc249c" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1534.033863] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2fc127c1-64d5-4545-935d-5499e2e4234b in Status: SUCCESS [ 1534.034194] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2fc127c1-64d5-4545-935d-5499e2e4234b" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1534.034256] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2fc127c1-64d5-4545-935d-5499e2e4234b" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1534.034461] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2fc127c1-64d5-4545-935d-5499e2e4234b" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1534.034639] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1534.034753] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1534.034816] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1534.034969] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1534.035059] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1534.035227] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2fc127c1-64d5-4545-935d-5499e2e4234b',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1534.537439] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2fc127c1-64d5-4545-935d-5499e2e4234b',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1535.040088] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2fc127c1-64d5-4545-935d-5499e2e4234b',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1535.542123] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1535.542385] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1535.542385] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1535.542629] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1535.542765] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1535.542878] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2fc127c1-64d5-4545-935d-5499e2e4234b is going to be updated. [ 1535.568846] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1535.569099] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1535.569099] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1535.569295] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1535.569445] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1535.577301] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2fc127c1-64d5-4545-935d-5499e2e4234b in Status: IN_PROGRESS for 2s [ 1536.974405] env[69188]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1536.974800] env[69188]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1537.587155] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2fc127c1-64d5-4545-935d-5499e2e4234b in Status: SUCCESS [ 1537.587361] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2fc127c1-64d5-4545-935d-5499e2e4234b" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1537.587517] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2fc127c1-64d5-4545-935d-5499e2e4234b" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1537.587718] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2fc127c1-64d5-4545-935d-5499e2e4234b" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1537.587906] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1537.588135] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1537.588135] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1537.588262] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1537.588324] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1537.588406] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2fc127c1-64d5-4545-935d-5499e2e4234b" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1537.588496] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2fc127c1-64d5-4545-935d-5499e2e4234b',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1538.090782] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2fc127c1-64d5-4545-935d-5499e2e4234b',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1538.593431] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2fc127c1-64d5-4545-935d-5499e2e4234b: rpc.has_security_group_logging(os_id): False [ 1538.610551] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1538.610728] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1538.610786] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1538.610949] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1538.611055] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1538.611297] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1538.611401] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1538.611464] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1538.611617] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1538.611695] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1538.611784] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2fc127c1-64d5-4545-935d-5499e2e4234b is going to be updated. [ 1538.666135] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1538.666328] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1538.666380] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1538.666534] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1538.666671] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1538.678374] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2fc127c1-64d5-4545-935d-5499e2e4234b in Status: IN_PROGRESS for 2s [ 1540.693945] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2fc127c1-64d5-4545-935d-5499e2e4234b in Status: SUCCESS [ 1540.694322] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2fc127c1-64d5-4545-935d-5499e2e4234b" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1541.976523] env[69188]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1541.976523] env[69188]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1544.159146] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1544.159528] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1544.159528] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1544.159605] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1544.159696] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1544.662439] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1545.164963] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1545.668757] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1545.668757] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1546.375056] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1546.375056] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1546.375056] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1546.375056] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1546.388039] env[69188]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1546.388909] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1546.389663] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1546.422961] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1546.423136] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1546.423185] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1546.423387] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1546.435191] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1546.435924] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1546.435996] env[69188]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=69188) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1546.436098] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1546.465354] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1546.465540] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1546.465540] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1546.465750] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1546.466405] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1546.466555] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1546.538163] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1546.538371] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1546.538371] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1546.538548] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1546.538837] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1546.539108] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1546.601839] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1546.602021] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1546.602021] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1546.602198] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1546.602458] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1546.602716] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:24. [ 1546.602812] env[69188]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'f85bb0c6-bf80-4499-b5c3-0b4c4169bdc0', '2c6aa97b-8577-4c5e-8b88-1678798f98a7', '22266528-0231-4142-81c2-081f9d6cd11d', 'c019210a-f261-4200-a6cd-a6e2fc4f9396', '86b3e666-35a3-418a-82c9-eb305c030ea1', '5e76d42e-7ec6-4a5e-aa9c-c5a285d62318', 'bec5fbed-ec5a-4f98-90d3-ee0000b97d09', 'e5ba8b1f-5099-48fb-8bd0-c413eb3b39f7', '9482bec7-7d68-4fe1-8d77-d380c3f6dc7a', '2fc127c1-64d5-4545-935d-5499e2e4234b', '460ab751-c0ea-45e9-bf76-9a767798212b', '5f183b9d-5066-4eee-a079-2adf3a1d0f7c', '870d4230-10cb-4ebd-8d12-34aaae29ea98', '867581e0-cbbd-4108-a823-0b7c53d47c3a', '53b2b927-2e3d-4111-b25a-7b34ab9fa28d', '55dcb887-f0db-4969-b757-e829798327eb', 'dbff1afa-14ec-4fad-8985-0fb6140d58bb', '9d153fe4-605f-47fe-a33b-9d019b977fa7', '721e26e3-d896-46ab-b5a3-92852a365813', 'b99e414b-ff9c-4d19-b3c8-32ab58288d75', '4e9db3bb-e903-42d7-b7e6-e365ea0c7f5f', '614b9fd7-ab13-4673-ace1-c5f03c5b9acc', '24a7b083-b432-46d6-94de-76adf6ce22b3', 'e275bda6-f504-45ea-9805-84ac49a67aa7'} {{(pid=69188) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1546.602916] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1546.619108] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1546.619283] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1546.619283] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1546.619449] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1546.619532] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1546.619632] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1546.619702] env[69188]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=69188) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1546.619773] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1546.688014] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1546.688206] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1546.688249] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1546.688413] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1546.689525] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1546.689779] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1546.689876] env[69188]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=69188) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1546.689952] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1546.690028] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1546.690109] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/24 resources of Type:Security Group Rules [ 1546.690184] env[69188]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f85bb0c6-bf80-4499-b5c3-0b4c4169bdc0 with Priority: HIGH for action security_group_rules [ 1546.690260] env[69188]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 2c6aa97b-8577-4c5e-8b88-1678798f98a7 with Priority: HIGH for action security_group_rules [ 1546.690323] env[69188]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 22266528-0231-4142-81c2-081f9d6cd11d with Priority: HIGH for action security_group_rules [ 1546.690383] env[69188]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c019210a-f261-4200-a6cd-a6e2fc4f9396 with Priority: HIGH for action security_group_rules [ 1546.690443] env[69188]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 86b3e666-35a3-418a-82c9-eb305c030ea1 with Priority: HIGH for action security_group_rules [ 1546.690505] env[69188]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 5e76d42e-7ec6-4a5e-aa9c-c5a285d62318 with Priority: HIGH for action security_group_rules [ 1546.690562] env[69188]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: bec5fbed-ec5a-4f98-90d3-ee0000b97d09 with Priority: HIGH for action security_group_rules [ 1546.690613] env[69188]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e5ba8b1f-5099-48fb-8bd0-c413eb3b39f7 with Priority: HIGH for action security_group_rules [ 1546.690676] env[69188]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9482bec7-7d68-4fe1-8d77-d380c3f6dc7a with Priority: HIGH for action security_group_rules [ 1546.690734] env[69188]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 2fc127c1-64d5-4545-935d-5499e2e4234b with Priority: HIGH for action security_group_rules [ 1546.690798] env[69188]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 460ab751-c0ea-45e9-bf76-9a767798212b with Priority: HIGH for action security_group_rules [ 1546.690877] env[69188]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 5f183b9d-5066-4eee-a079-2adf3a1d0f7c with Priority: HIGH for action security_group_rules [ 1546.690940] env[69188]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 870d4230-10cb-4ebd-8d12-34aaae29ea98 with Priority: HIGH for action security_group_rules [ 1546.690998] env[69188]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 867581e0-cbbd-4108-a823-0b7c53d47c3a with Priority: HIGH for action security_group_rules [ 1546.691067] env[69188]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 53b2b927-2e3d-4111-b25a-7b34ab9fa28d with Priority: HIGH for action security_group_rules [ 1546.691118] env[69188]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 55dcb887-f0db-4969-b757-e829798327eb with Priority: HIGH for action security_group_rules [ 1546.691181] env[69188]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: dbff1afa-14ec-4fad-8985-0fb6140d58bb with Priority: HIGH for action security_group_rules [ 1546.691237] env[69188]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9d153fe4-605f-47fe-a33b-9d019b977fa7 with Priority: HIGH for action security_group_rules [ 1546.691297] env[69188]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 721e26e3-d896-46ab-b5a3-92852a365813 with Priority: HIGH for action security_group_rules [ 1546.691358] env[69188]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b99e414b-ff9c-4d19-b3c8-32ab58288d75 with Priority: HIGH for action security_group_rules [ 1546.691445] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1546.977515] env[69188]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1546.977741] env[69188]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=20], Jobs=0 [ 1546.977741] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f85bb0c6-bf80-4499-b5c3-0b4c4169bdc0 with Priority: HIGH for action security_group_rules [ 1546.977830] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 22266528-0231-4142-81c2-081f9d6cd11d with Priority: HIGH for action security_group_rules [ 1546.977912] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bec5fbed-ec5a-4f98-90d3-ee0000b97d09 with Priority: HIGH for action security_group_rules [ 1546.978022] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 53b2b927-2e3d-4111-b25a-7b34ab9fa28d with Priority: HIGH for action security_group_rules [ 1546.978124] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b99e414b-ff9c-4d19-b3c8-32ab58288d75 with Priority: HIGH for action security_group_rules [ 1546.978214] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 721e26e3-d896-46ab-b5a3-92852a365813 with Priority: HIGH for action security_group_rules [ 1546.978328] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9d153fe4-605f-47fe-a33b-9d019b977fa7 with Priority: HIGH for action security_group_rules [ 1546.978497] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dbff1afa-14ec-4fad-8985-0fb6140d58bb with Priority: HIGH for action security_group_rules [ 1546.978674] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 867581e0-cbbd-4108-a823-0b7c53d47c3a with Priority: HIGH for action security_group_rules [ 1546.978832] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55dcb887-f0db-4969-b757-e829798327eb with Priority: HIGH for action security_group_rules [ 1546.978945] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 870d4230-10cb-4ebd-8d12-34aaae29ea98 with Priority: HIGH for action security_group_rules [ 1546.979049] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5f183b9d-5066-4eee-a079-2adf3a1d0f7c with Priority: HIGH for action security_group_rules [ 1546.979139] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 460ab751-c0ea-45e9-bf76-9a767798212b with Priority: HIGH for action security_group_rules [ 1546.979227] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2fc127c1-64d5-4545-935d-5499e2e4234b with Priority: HIGH for action security_group_rules [ 1546.979311] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9482bec7-7d68-4fe1-8d77-d380c3f6dc7a with Priority: HIGH for action security_group_rules [ 1546.979396] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e76d42e-7ec6-4a5e-aa9c-c5a285d62318 with Priority: HIGH for action security_group_rules [ 1546.979480] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e5ba8b1f-5099-48fb-8bd0-c413eb3b39f7 with Priority: HIGH for action security_group_rules [ 1546.979611] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 86b3e666-35a3-418a-82c9-eb305c030ea1 with Priority: HIGH for action security_group_rules [ 1546.979744] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c6aa97b-8577-4c5e-8b88-1678798f98a7 with Priority: HIGH for action security_group_rules [ 1546.979837] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c019210a-f261-4200-a6cd-a6e2fc4f9396 with Priority: HIGH for action security_group_rules [ 1546.980266] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f85bb0c6-bf80-4499-b5c3-0b4c4169bdc0 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1546.980457] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f85bb0c6-bf80-4499-b5c3-0b4c4169bdc0" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1546.980555] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f85bb0c6-bf80-4499-b5c3-0b4c4169bdc0" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1546.980869] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f85bb0c6-bf80-4499-b5c3-0b4c4169bdc0" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1546.981025] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f85bb0c6-bf80-4499-b5c3-0b4c4169bdc0',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1546.982170] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-22266528-0231-4142-81c2-081f9d6cd11d taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1546.982300] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-22266528-0231-4142-81c2-081f9d6cd11d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1546.982386] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-22266528-0231-4142-81c2-081f9d6cd11d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1546.982607] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-22266528-0231-4142-81c2-081f9d6cd11d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1546.982692] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('22266528-0231-4142-81c2-081f9d6cd11d',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1546.983597] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bec5fbed-ec5a-4f98-90d3-ee0000b97d09 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1546.983703] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bec5fbed-ec5a-4f98-90d3-ee0000b97d09" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1546.983766] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bec5fbed-ec5a-4f98-90d3-ee0000b97d09" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1546.983906] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bec5fbed-ec5a-4f98-90d3-ee0000b97d09" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1546.984021] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bec5fbed-ec5a-4f98-90d3-ee0000b97d09',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1546.985161] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-53b2b927-2e3d-4111-b25a-7b34ab9fa28d taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1546.985318] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-53b2b927-2e3d-4111-b25a-7b34ab9fa28d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1546.985383] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-53b2b927-2e3d-4111-b25a-7b34ab9fa28d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1546.985498] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-53b2b927-2e3d-4111-b25a-7b34ab9fa28d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1546.985572] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('53b2b927-2e3d-4111-b25a-7b34ab9fa28d',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1546.986238] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b99e414b-ff9c-4d19-b3c8-32ab58288d75 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1546.986343] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b99e414b-ff9c-4d19-b3c8-32ab58288d75" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1546.986401] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b99e414b-ff9c-4d19-b3c8-32ab58288d75" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1546.986543] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b99e414b-ff9c-4d19-b3c8-32ab58288d75" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1546.986615] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b99e414b-ff9c-4d19-b3c8-32ab58288d75',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1546.987289] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-721e26e3-d896-46ab-b5a3-92852a365813 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1546.987396] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-721e26e3-d896-46ab-b5a3-92852a365813" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1546.987459] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-721e26e3-d896-46ab-b5a3-92852a365813" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1546.987607] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-721e26e3-d896-46ab-b5a3-92852a365813" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1546.987673] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('721e26e3-d896-46ab-b5a3-92852a365813',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1546.988376] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9d153fe4-605f-47fe-a33b-9d019b977fa7 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1546.988521] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9d153fe4-605f-47fe-a33b-9d019b977fa7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1546.988569] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9d153fe4-605f-47fe-a33b-9d019b977fa7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1546.988688] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9d153fe4-605f-47fe-a33b-9d019b977fa7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1546.988761] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9d153fe4-605f-47fe-a33b-9d019b977fa7',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1546.989531] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dbff1afa-14ec-4fad-8985-0fb6140d58bb taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1546.989721] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dbff1afa-14ec-4fad-8985-0fb6140d58bb" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1546.989721] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dbff1afa-14ec-4fad-8985-0fb6140d58bb" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1546.989845] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dbff1afa-14ec-4fad-8985-0fb6140d58bb" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1546.989906] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dbff1afa-14ec-4fad-8985-0fb6140d58bb',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1546.990588] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-867581e0-cbbd-4108-a823-0b7c53d47c3a taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1546.990694] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-867581e0-cbbd-4108-a823-0b7c53d47c3a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1546.990758] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-867581e0-cbbd-4108-a823-0b7c53d47c3a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1546.990906] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-867581e0-cbbd-4108-a823-0b7c53d47c3a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1546.990978] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('867581e0-cbbd-4108-a823-0b7c53d47c3a',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1546.991750] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-55dcb887-f0db-4969-b757-e829798327eb taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1546.991750] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-55dcb887-f0db-4969-b757-e829798327eb" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1546.991873] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-55dcb887-f0db-4969-b757-e829798327eb" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1546.991937] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-55dcb887-f0db-4969-b757-e829798327eb" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1546.992018] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('55dcb887-f0db-4969-b757-e829798327eb',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1546.992733] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-870d4230-10cb-4ebd-8d12-34aaae29ea98 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1546.992905] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-870d4230-10cb-4ebd-8d12-34aaae29ea98" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1546.992951] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-870d4230-10cb-4ebd-8d12-34aaae29ea98" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1546.993095] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-870d4230-10cb-4ebd-8d12-34aaae29ea98" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1546.993172] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('870d4230-10cb-4ebd-8d12-34aaae29ea98',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1546.993843] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5f183b9d-5066-4eee-a079-2adf3a1d0f7c taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1546.993948] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5f183b9d-5066-4eee-a079-2adf3a1d0f7c" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1546.993997] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5f183b9d-5066-4eee-a079-2adf3a1d0f7c" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1546.994158] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5f183b9d-5066-4eee-a079-2adf3a1d0f7c" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1546.994227] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5f183b9d-5066-4eee-a079-2adf3a1d0f7c',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1546.994964] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-460ab751-c0ea-45e9-bf76-9a767798212b taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1546.995048] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-460ab751-c0ea-45e9-bf76-9a767798212b" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1546.995088] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-460ab751-c0ea-45e9-bf76-9a767798212b" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1546.995210] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-460ab751-c0ea-45e9-bf76-9a767798212b" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1546.995318] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('460ab751-c0ea-45e9-bf76-9a767798212b',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1546.996056] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2fc127c1-64d5-4545-935d-5499e2e4234b taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1546.996056] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2fc127c1-64d5-4545-935d-5499e2e4234b" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1546.996164] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2fc127c1-64d5-4545-935d-5499e2e4234b" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1546.996285] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2fc127c1-64d5-4545-935d-5499e2e4234b" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1546.996356] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2fc127c1-64d5-4545-935d-5499e2e4234b',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1546.997152] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9482bec7-7d68-4fe1-8d77-d380c3f6dc7a taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1546.997264] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9482bec7-7d68-4fe1-8d77-d380c3f6dc7a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1546.997326] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9482bec7-7d68-4fe1-8d77-d380c3f6dc7a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1546.997435] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9482bec7-7d68-4fe1-8d77-d380c3f6dc7a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1546.997507] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9482bec7-7d68-4fe1-8d77-d380c3f6dc7a',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1546.998224] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5e76d42e-7ec6-4a5e-aa9c-c5a285d62318 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1546.998330] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5e76d42e-7ec6-4a5e-aa9c-c5a285d62318" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1546.998398] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5e76d42e-7ec6-4a5e-aa9c-c5a285d62318" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1546.998548] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5e76d42e-7ec6-4a5e-aa9c-c5a285d62318" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1546.998660] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5e76d42e-7ec6-4a5e-aa9c-c5a285d62318',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1546.999270] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e5ba8b1f-5099-48fb-8bd0-c413eb3b39f7 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1546.999428] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e5ba8b1f-5099-48fb-8bd0-c413eb3b39f7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1546.999500] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e5ba8b1f-5099-48fb-8bd0-c413eb3b39f7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1546.999666] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e5ba8b1f-5099-48fb-8bd0-c413eb3b39f7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1546.999769] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e5ba8b1f-5099-48fb-8bd0-c413eb3b39f7',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1547.000403] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-86b3e666-35a3-418a-82c9-eb305c030ea1 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1547.000530] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-86b3e666-35a3-418a-82c9-eb305c030ea1" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1547.000598] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-86b3e666-35a3-418a-82c9-eb305c030ea1" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1547.000761] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-86b3e666-35a3-418a-82c9-eb305c030ea1" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1547.000833] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('86b3e666-35a3-418a-82c9-eb305c030ea1',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1547.001610] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2c6aa97b-8577-4c5e-8b88-1678798f98a7 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1547.001716] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2c6aa97b-8577-4c5e-8b88-1678798f98a7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1547.001857] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2c6aa97b-8577-4c5e-8b88-1678798f98a7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1547.001927] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2c6aa97b-8577-4c5e-8b88-1678798f98a7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1547.001997] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2c6aa97b-8577-4c5e-8b88-1678798f98a7',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1547.002675] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c019210a-f261-4200-a6cd-a6e2fc4f9396 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1547.002779] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c019210a-f261-4200-a6cd-a6e2fc4f9396" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1547.002845] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c019210a-f261-4200-a6cd-a6e2fc4f9396" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1547.002992] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c019210a-f261-4200-a6cd-a6e2fc4f9396" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1547.003077] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c019210a-f261-4200-a6cd-a6e2fc4f9396',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1547.027776] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1547.028022] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1547.028022] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1547.028213] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1547.033777] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1547.033944] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1547.037295] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1547.037464] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1547.045116] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1547.045230] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f85bb0c6-bf80-4499-b5c3-0b4c4169bdc0 is going to be deleted. [ 1547.046148] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1547.046377] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1547.063659] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1547.063779] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 53b2b927-2e3d-4111-b25a-7b34ab9fa28d is going to be deleted. [ 1547.064548] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1547.064748] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1547.079604] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1547.079752] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bec5fbed-ec5a-4f98-90d3-ee0000b97d09 is going to be deleted. [ 1547.118467] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1547.118675] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1547.118675] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1547.118886] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1547.118976] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1547.119126] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-53b2b927-2e3d-4111-b25a-7b34ab9fa28d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1547.120069] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1547.120069] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1547.120069] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1547.120498] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1547.120498] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1547.120498] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f85bb0c6-bf80-4499-b5c3-0b4c4169bdc0" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1547.179966] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1547.180245] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1547.180245] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1547.180547] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1547.180682] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1547.180865] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bec5fbed-ec5a-4f98-90d3-ee0000b97d09" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1547.514489] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-2fc127c1-64d5-4545-935d-5499e2e4234b taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1547.514827] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2fc127c1-64d5-4545-935d-5499e2e4234b" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1547.514827] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2fc127c1-64d5-4545-935d-5499e2e4234b" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1547.514925] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2fc127c1-64d5-4545-935d-5499e2e4234b" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1547.515059] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1547.515155] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1547.515234] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1547.515442] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1547.515522] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1547.515607] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2fc127c1-64d5-4545-935d-5499e2e4234b" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1547.515694] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2fc127c1-64d5-4545-935d-5499e2e4234b',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1547.551748] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1547.551920] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1547.551920] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1547.552123] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1547.556658] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1547.556782] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1547.557435] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1547.557528] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1547.563168] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1547.563314] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1547.563994] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1547.564095] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1547.573415] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1547.573534] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1547.574170] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1547.574262] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1547.578215] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1547.578321] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1547.578980] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1547.579093] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1547.579807] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1547.579913] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1547.580575] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1547.580668] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1547.581254] env[69188]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1547.581625] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1547.581723] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1547.582305] env[69188]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1547.582655] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1547.582759] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1547.583316] env[69188]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1547.583701] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1547.583793] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1547.584365] env[69188]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1547.584784] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1547.584872] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1547.585482] env[69188]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1547.585857] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1547.585939] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1547.586540] env[69188]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1547.586926] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1547.587045] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9482bec7-7d68-4fe1-8d77-d380c3f6dc7a is going to be deleted. [ 1547.587841] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1547.588037] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1547.601638] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1547.601743] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 870d4230-10cb-4ebd-8d12-34aaae29ea98 is going to be deleted. [ 1547.602426] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1547.602595] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1547.616542] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1547.616640] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e5ba8b1f-5099-48fb-8bd0-c413eb3b39f7 is going to be deleted. [ 1547.617328] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1547.617498] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1547.633278] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1547.633403] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 867581e0-cbbd-4108-a823-0b7c53d47c3a is going to be deleted. [ 1547.634077] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1547.634242] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1547.638276] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1547.638403] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1547.654227] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1547.654332] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1547.654932] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1547.655060] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5e76d42e-7ec6-4a5e-aa9c-c5a285d62318 is going to be deleted. [ 1547.655767] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1547.655933] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1547.663927] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1547.664041] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1547.769849] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1547.769990] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 55dcb887-f0db-4969-b757-e829798327eb is going to be deleted. [ 1547.770779] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1547.770972] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1547.811360] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1547.811511] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1547.814815] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1547.814931] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1547.834621] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1547.834722] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2c6aa97b-8577-4c5e-8b88-1678798f98a7 is going to be deleted. [ 1547.835517] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1547.835708] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1547.897159] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1547.897314] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1547.917617] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1547.917757] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 460ab751-c0ea-45e9-bf76-9a767798212b is going to be deleted. [ 1547.918655] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1547.918870] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1547.992127] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1547.992293] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 22266528-0231-4142-81c2-081f9d6cd11d is going to be deleted. [ 1547.993159] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1547.993377] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1548.017427] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1548.017591] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1548.018336] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1548.018446] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dbff1afa-14ec-4fad-8985-0fb6140d58bb is going to be deleted. [ 1548.019146] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1548.019321] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1548.020130] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2fc127c1-64d5-4545-935d-5499e2e4234b',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1548.033884] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1548.034038] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1548.064168] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1548.064263] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5f183b9d-5066-4eee-a079-2adf3a1d0f7c is going to be deleted. [ 1548.064984] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1548.065177] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1548.076223] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1548.076348] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1548.102464] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1548.102568] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c019210a-f261-4200-a6cd-a6e2fc4f9396 is going to be deleted. [ 1548.103279] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1548.103455] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1548.111957] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1548.112065] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1548.163987] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1548.164133] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 721e26e3-d896-46ab-b5a3-92852a365813 is going to be deleted. [ 1548.164974] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1548.165193] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1548.213233] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1548.213376] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9d153fe4-605f-47fe-a33b-9d019b977fa7 is going to be deleted. [ 1548.214166] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1548.214376] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1548.215715] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1548.215832] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1548.233780] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1548.233931] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1548.268346] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1548.268487] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 86b3e666-35a3-418a-82c9-eb305c030ea1 is going to be deleted. [ 1548.269325] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1548.269535] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1548.295734] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1548.295863] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b99e414b-ff9c-4d19-b3c8-32ab58288d75 is going to be deleted. [ 1548.296647] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1548.296855] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1548.296945] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1548.297081] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9482bec7-7d68-4fe1-8d77-d380c3f6dc7a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1548.297231] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1548.297384] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1548.297464] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1548.297574] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-870d4230-10cb-4ebd-8d12-34aaae29ea98" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1548.297999] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1548.298175] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1548.298256] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1548.298369] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e5ba8b1f-5099-48fb-8bd0-c413eb3b39f7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1548.298499] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1548.298641] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1548.298717] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1548.298827] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5e76d42e-7ec6-4a5e-aa9c-c5a285d62318" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1548.298948] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1548.299102] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1548.299178] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1548.299294] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-867581e0-cbbd-4108-a823-0b7c53d47c3a" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1548.299419] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1548.299557] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1548.299630] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1548.299744] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-55dcb887-f0db-4969-b757-e829798327eb" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1548.299867] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1548.300008] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1548.300089] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1548.300196] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2c6aa97b-8577-4c5e-8b88-1678798f98a7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1548.300320] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1548.300463] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1548.300537] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1548.300641] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-460ab751-c0ea-45e9-bf76-9a767798212b" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1548.300763] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1548.300899] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1548.300971] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1548.301094] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-22266528-0231-4142-81c2-081f9d6cd11d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1548.301218] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1548.301354] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1548.301429] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1548.301537] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dbff1afa-14ec-4fad-8985-0fb6140d58bb" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1548.301656] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1548.301789] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1548.301862] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1548.301971] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5f183b9d-5066-4eee-a079-2adf3a1d0f7c" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1548.302665] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1548.302770] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1548.302837] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1548.302983] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1548.303073] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1548.303181] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-721e26e3-d896-46ab-b5a3-92852a365813" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1548.303321] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1548.303468] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1548.303545] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1548.303648] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c019210a-f261-4200-a6cd-a6e2fc4f9396" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1548.350470] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1548.350639] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1548.350685] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1548.350843] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1548.350928] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1548.351056] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9d153fe4-605f-47fe-a33b-9d019b977fa7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1548.421980] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1548.422293] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1548.422293] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1548.422561] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1548.422672] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1548.422797] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b99e414b-ff9c-4d19-b3c8-32ab58288d75" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1548.423690] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1548.423869] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1548.423939] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1548.424172] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1548.424330] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1548.424420] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-86b3e666-35a3-418a-82c9-eb305c030ea1" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1548.522010] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2fc127c1-64d5-4545-935d-5499e2e4234b: rpc.has_security_group_logging(os_id): False [ 1548.549860] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1548.550092] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1548.550092] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1548.550287] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1548.586859] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1548.587288] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1548.587418] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1548.587485] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1548.587706] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1548.587806] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1548.587896] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2fc127c1-64d5-4545-935d-5499e2e4234b is going to be updated. [ 1548.642084] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1548.642273] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1548.642314] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1548.642497] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1548.642643] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1548.657649] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2fc127c1-64d5-4545-935d-5499e2e4234b in Status: IN_PROGRESS for 2s [ 1550.674489] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2fc127c1-64d5-4545-935d-5499e2e4234b in Status: SUCCESS [ 1550.674906] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2fc127c1-64d5-4545-935d-5499e2e4234b" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1551.981355] env[69188]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1551.981762] env[69188]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1556.982973] env[69188]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1556.983391] env[69188]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1561.983686] env[69188]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1561.983982] env[69188]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1566.985290] env[69188]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1566.985692] env[69188]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1571.986459] env[69188]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1571.986834] env[69188]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1576.987279] env[69188]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1576.987675] env[69188]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1581.988278] env[69188]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1581.988592] env[69188]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1586.989337] env[69188]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1586.989655] env[69188]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1591.990150] env[69188]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1591.990487] env[69188]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1596.991812] env[69188]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1596.992229] env[69188]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1598.764637] env[69188]: INFO networking_nsxv3.common.synchronization [req-a7f1a395-ffae-485c-95e8-1cb3518f074f req-b9cdd527-7d0a-403f-a60d-24e53444d536 tempest-ServerActionsTestOtherA-1252171107 tempest-ServerActionsTestOtherA-1252171107-project-member] Enqueued Resource ID: 2fc127c1-64d5-4545-935d-5499e2e4234b with Priority: HIGHEST for action security_group_members [ 1598.764877] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2fc127c1-64d5-4545-935d-5499e2e4234b with Priority: HIGHEST for action security_group_members [ 1598.765195] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-2fc127c1-64d5-4545-935d-5499e2e4234b taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1598.765320] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2fc127c1-64d5-4545-935d-5499e2e4234b" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1598.765384] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2fc127c1-64d5-4545-935d-5499e2e4234b" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1598.765585] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2fc127c1-64d5-4545-935d-5499e2e4234b" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1598.765753] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1598.765855] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1598.765915] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1598.766229] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1598.766351] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1598.766413] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2fc127c1-64d5-4545-935d-5499e2e4234b',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1599.269277] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2fc127c1-64d5-4545-935d-5499e2e4234b',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1599.771888] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2fc127c1-64d5-4545-935d-5499e2e4234b',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1600.273754] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1600.273980] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1600.274052] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1600.274236] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1600.274332] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1600.274430] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2fc127c1-64d5-4545-935d-5499e2e4234b is going to be updated. [ 1600.303149] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1600.303345] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1600.303410] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1600.303642] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1600.303775] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1600.317831] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2fc127c1-64d5-4545-935d-5499e2e4234b in Status: IN_PROGRESS for 2s [ 1602.328537] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2fc127c1-64d5-4545-935d-5499e2e4234b in Status: SUCCESS [ 1602.328959] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2fc127c1-64d5-4545-935d-5499e2e4234b" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1603.766653] env[69188]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1603.767052] env[69188]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1608.767595] env[69188]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1608.767973] env[69188]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1613.769294] env[69188]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1613.769294] env[69188]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1614.969411] env[69188]: INFO networking_nsxv3.common.synchronization [req-40bd228a-8af3-4daa-87eb-0424de3bea72 req-f9f7d644-d690-4c8c-ae45-d5423485075e tempest-ServerActionsTestOtherA-1252171107 tempest-ServerActionsTestOtherA-1252171107-project-member] Enqueued Resource ID: 2fc127c1-64d5-4545-935d-5499e2e4234b with Priority: HIGHEST for action security_group_members [ 1614.970196] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2fc127c1-64d5-4545-935d-5499e2e4234b with Priority: HIGHEST for action security_group_members [ 1614.970324] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-2fc127c1-64d5-4545-935d-5499e2e4234b taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1614.970467] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2fc127c1-64d5-4545-935d-5499e2e4234b" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1614.970467] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2fc127c1-64d5-4545-935d-5499e2e4234b" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1614.970675] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2fc127c1-64d5-4545-935d-5499e2e4234b" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1614.970762] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1614.970886] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1614.970886] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1614.971209] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1614.971209] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1614.971209] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2fc127c1-64d5-4545-935d-5499e2e4234b',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1615.473791] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1615.474060] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1615.474060] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1615.474259] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1615.474356] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1615.474553] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1615.474648] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1615.474712] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1615.474856] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1615.474932] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1615.475029] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2fc127c1-64d5-4545-935d-5499e2e4234b is going to be updated. [ 1615.571449] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1615.571605] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1615.571656] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1615.571839] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1615.571974] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1615.580333] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2fc127c1-64d5-4545-935d-5499e2e4234b in Status: IN_PROGRESS for 2s [ 1617.592623] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2fc127c1-64d5-4545-935d-5499e2e4234b in Status: SUCCESS [ 1617.593062] env[69188]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2fc127c1-64d5-4545-935d-5499e2e4234b deletion is rescheduled due to dependency. [ 1617.593062] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2fc127c1-64d5-4545-935d-5499e2e4234b" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1619.971235] env[69188]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1619.971620] env[69188]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1623.038073] env[69188]: INFO networking_nsxv3.common.synchronization [None req-060d9adb-6e08-4923-9826-e3d8e8f724a5 None None] Enqueued Resource ID: 7a23645d-9b20-46fe-9ddd-70b0ed641de8 with Priority: HIGHEST for action port [ 1623.038321] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a23645d-9b20-46fe-9ddd-70b0ed641de8 with Priority: HIGHEST for action port [ 1623.038815] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-7a23645d-9b20-46fe-9ddd-70b0ed641de8 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1623.038890] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7a23645d-9b20-46fe-9ddd-70b0ed641de8" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1623.038955] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7a23645d-9b20-46fe-9ddd-70b0ed641de8" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1623.039229] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7a23645d-9b20-46fe-9ddd-70b0ed641de8" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1623.039303] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7a23645d-9b20-46fe-9ddd-70b0ed641de8',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1623.218066] env[69188]: INFO networking_nsxv3.common.synchronization [None req-55ad85d3-40dd-4a97-937f-c50f6a4fe35c tempest-AttachVolumeTestJSON-519629187 tempest-AttachVolumeTestJSON-519629187-project-member] Enqueued Resource ID: 241497b1-2809-46a0-8d59-95f9523f1e58 with Priority: HIGHEST for action security_group_rules [ 1623.218217] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 241497b1-2809-46a0-8d59-95f9523f1e58 with Priority: HIGHEST for action security_group_rules [ 1623.218592] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-241497b1-2809-46a0-8d59-95f9523f1e58 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1623.218727] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-241497b1-2809-46a0-8d59-95f9523f1e58" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1623.218795] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-241497b1-2809-46a0-8d59-95f9523f1e58" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1623.219209] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-241497b1-2809-46a0-8d59-95f9523f1e58" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1623.219332] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('241497b1-2809-46a0-8d59-95f9523f1e58',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1623.282984] env[69188]: INFO networking_nsxv3.common.synchronization [None req-ea7f4e86-f3a4-449a-b512-a9de21700e02 tempest-AttachVolumeTestJSON-519629187 tempest-AttachVolumeTestJSON-519629187-project-member] Enqueued Resource ID: 241497b1-2809-46a0-8d59-95f9523f1e58 with Priority: HIGHEST for action security_group_rules [ 1623.283614] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 241497b1-2809-46a0-8d59-95f9523f1e58 with Priority: HIGHEST for action security_group_rules [ 1623.283965] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-241497b1-2809-46a0-8d59-95f9523f1e58 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1623.284085] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-241497b1-2809-46a0-8d59-95f9523f1e58" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1623.542039] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7a23645d-9b20-46fe-9ddd-70b0ed641de8 [ 1623.542347] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1623.542493] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1623.542575] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1623.542769] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1623.542859] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1623.542952] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7a23645d-9b20-46fe-9ddd-70b0ed641de8 already deleted. [ 1623.543050] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7a23645d-9b20-46fe-9ddd-70b0ed641de8" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1623.741031] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1623.741031] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1623.741031] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1623.741031] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1623.741031] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1623.741031] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 241497b1-2809-46a0-8d59-95f9523f1e58 already deleted. [ 1623.741031] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-241497b1-2809-46a0-8d59-95f9523f1e58" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1623.741031] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-241497b1-2809-46a0-8d59-95f9523f1e58" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1623.741031] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-241497b1-2809-46a0-8d59-95f9523f1e58" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1623.741031] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('241497b1-2809-46a0-8d59-95f9523f1e58',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1624.260867] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1624.261235] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1624.261235] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1624.261386] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1624.261496] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1624.261591] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 241497b1-2809-46a0-8d59-95f9523f1e58 already deleted. [ 1624.261672] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-241497b1-2809-46a0-8d59-95f9523f1e58" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1624.751235] env[69188]: INFO networking_nsxv3.common.synchronization [None req-6b55c01a-3767-4c00-8044-424fb1521604 None None] Enqueued Resource ID: f0db4eec-6262-4ef5-983c-f19c06d1d202 with Priority: HIGHEST for action port [ 1624.751497] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f0db4eec-6262-4ef5-983c-f19c06d1d202 with Priority: HIGHEST for action port [ 1624.752043] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-f0db4eec-6262-4ef5-983c-f19c06d1d202 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1624.752173] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f0db4eec-6262-4ef5-983c-f19c06d1d202" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1624.752236] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f0db4eec-6262-4ef5-983c-f19c06d1d202" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1624.752496] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f0db4eec-6262-4ef5-983c-f19c06d1d202" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1624.752581] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f0db4eec-6262-4ef5-983c-f19c06d1d202',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1625.254809] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f0db4eec-6262-4ef5-983c-f19c06d1d202 [ 1625.255079] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1625.255219] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1625.255285] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1625.255489] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1625.255578] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1625.255674] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f0db4eec-6262-4ef5-983c-f19c06d1d202 already deleted. [ 1625.255754] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f0db4eec-6262-4ef5-983c-f19c06d1d202" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1628.515150] env[69188]: INFO networking_nsxv3.common.synchronization [req-00db0422-22ce-48c8-bbca-d98169dad49c req-7a6a2e9e-3f0f-4959-890b-afa27d862483 tempest-AttachVolumeTestJSON-519629187 tempest-AttachVolumeTestJSON-519629187-project-member] Enqueued Resource ID: 241497b1-2809-46a0-8d59-95f9523f1e58 with Priority: HIGHEST for action security_group_members [ 1628.515684] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 241497b1-2809-46a0-8d59-95f9523f1e58 with Priority: HIGHEST for action security_group_members [ 1628.515985] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-241497b1-2809-46a0-8d59-95f9523f1e58 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1628.516255] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-241497b1-2809-46a0-8d59-95f9523f1e58" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1628.516327] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-241497b1-2809-46a0-8d59-95f9523f1e58" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1628.516608] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-241497b1-2809-46a0-8d59-95f9523f1e58" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1628.516877] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1628.517033] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1628.517138] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1628.517241] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1628.517332] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1628.517428] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('241497b1-2809-46a0-8d59-95f9523f1e58',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1628.736583] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock network-94 taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1628.736789] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "network-94" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1628.736918] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "network-94" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1628.737278] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "network-94" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1628.737574] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1628.737856] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1628.738015] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1628.738243] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1628.738396] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1628.738631] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1628.738747] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] NeedRegenerationException {{(pid=69188) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1628.738861] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] no value, waiting for create lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1628.739015] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] value creation lock acquired {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1628.739168] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1628.739282] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Calling creation function for not-yet-present value {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1628.739424] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1628.759897] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1628.760067] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69188) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1628.760206] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Released creation lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1628.760374] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "network-94" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1628.760649] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock port-7e5da00e-77a9-4135-8626-a72c42ad507e taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1628.760813] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "port-7e5da00e-77a9-4135-8626-a72c42ad507e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1628.760937] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "port-7e5da00e-77a9-4135-8626-a72c42ad507e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1628.761236] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "port-7e5da00e-77a9-4135-8626-a72c42ad507e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1628.761382] env[69188]: DEBUG networking_nsxv3.api.rpc [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7e5da00e-77a9-4135-8626-a72c42ad507e',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1629.019741] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1629.019993] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1629.019993] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1629.020153] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1629.020237] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1629.020430] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1629.020532] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1629.020599] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1629.020748] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1629.020826] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1629.020905] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 241497b1-2809-46a0-8d59-95f9523f1e58 already deleted. [ 1629.020983] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-241497b1-2809-46a0-8d59-95f9523f1e58" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1629.264262] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1629.264492] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1629.264615] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1629.264908] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1629.265078] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1629.265251] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Segment Port 7e5da00e-77a9-4135-8626-a72c42ad507e not found, creating... [ 1629.265514] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1629.265677] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1629.265797] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1629.266033] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1629.266194] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1629.266484] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1629.266674] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1629.266799] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1629.267017] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1629.267745] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1629.267745] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Resource: SegmentPort with ID: 7e5da00e-77a9-4135-8626-a72c42ad507e is going to be created. [ 1629.286604] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1629.286794] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1629.286920] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1629.287184] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1629.287405] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1629.287625] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "port-7e5da00e-77a9-4135-8626-a72c42ad507e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1629.949624] env[69188]: INFO networking_nsxv3.common.synchronization [req-00db0422-22ce-48c8-bbca-d98169dad49c req-ec970d58-92c9-4eab-9558-7c89878520f1 service nova] Enqueued Resource ID: 241497b1-2809-46a0-8d59-95f9523f1e58 with Priority: HIGHEST for action security_group_rules [ 1629.949868] env[69188]: INFO networking_nsxv3.common.synchronization [req-00db0422-22ce-48c8-bbca-d98169dad49c req-ec970d58-92c9-4eab-9558-7c89878520f1 service nova] Enqueued Resource ID: 241497b1-2809-46a0-8d59-95f9523f1e58 with Priority: HIGHEST for action security_group_members [ 1629.949958] env[69188]: INFO networking_nsxv3.common.synchronization [req-00db0422-22ce-48c8-bbca-d98169dad49c req-ec970d58-92c9-4eab-9558-7c89878520f1 service nova] Enqueued Resource ID: 7e5da00e-77a9-4135-8626-a72c42ad507e with Priority: HIGHEST for action port [ 1629.950463] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 241497b1-2809-46a0-8d59-95f9523f1e58 with Priority: HIGHEST for action security_group_rules [ 1629.950602] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 241497b1-2809-46a0-8d59-95f9523f1e58 with Priority: HIGHEST for action security_group_members [ 1629.950734] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e5da00e-77a9-4135-8626-a72c42ad507e with Priority: HIGHEST for action port [ 1629.950969] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-241497b1-2809-46a0-8d59-95f9523f1e58 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1629.951548] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-241497b1-2809-46a0-8d59-95f9523f1e58" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1629.951626] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-241497b1-2809-46a0-8d59-95f9523f1e58" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1629.952492] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-241497b1-2809-46a0-8d59-95f9523f1e58" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1629.952584] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('241497b1-2809-46a0-8d59-95f9523f1e58',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1629.954188] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-241497b1-2809-46a0-8d59-95f9523f1e58 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1629.954390] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-241497b1-2809-46a0-8d59-95f9523f1e58" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1629.954475] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-241497b1-2809-46a0-8d59-95f9523f1e58" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1629.954648] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-241497b1-2809-46a0-8d59-95f9523f1e58" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1629.954800] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1629.954899] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1629.954959] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1629.955117] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1629.955205] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1629.955292] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('241497b1-2809-46a0-8d59-95f9523f1e58',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1629.956345] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-7e5da00e-77a9-4135-8626-a72c42ad507e taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1629.956463] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7e5da00e-77a9-4135-8626-a72c42ad507e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1629.956514] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7e5da00e-77a9-4135-8626-a72c42ad507e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1629.956664] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7e5da00e-77a9-4135-8626-a72c42ad507e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1629.956885] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7e5da00e-77a9-4135-8626-a72c42ad507e',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1630.455165] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-241497b1-2809-46a0-8d59-95f9523f1e58 taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1630.455332] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-241497b1-2809-46a0-8d59-95f9523f1e58" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1630.456687] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('241497b1-2809-46a0-8d59-95f9523f1e58',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1630.459041] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7e5da00e-77a9-4135-8626-a72c42ad507e with status ACTIVE [ 1630.459251] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1630.459386] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1630.459452] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1630.459774] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1630.459774] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1630.459896] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1630.459989] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1630.460054] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1630.460206] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1630.460279] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1630.460456] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1630.460559] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1630.460612] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1630.460884] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1630.460884] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1630.460884] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7e5da00e-77a9-4135-8626-a72c42ad507e is going to be updated. [ 1630.480695] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1630.480864] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1630.480920] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1630.481093] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1630.481227] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1630.481377] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7e5da00e-77a9-4135-8626-a72c42ad507e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1630.958442] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('241497b1-2809-46a0-8d59-95f9523f1e58',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1631.461296] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1631.461543] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1631.461543] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1631.461888] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1631.462089] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1631.462272] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 241497b1-2809-46a0-8d59-95f9523f1e58 is going to be created. [ 1631.486343] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1631.486523] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1631.486566] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1631.487123] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1631.487123] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1631.495735] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 241497b1-2809-46a0-8d59-95f9523f1e58 in Status: UNINITIALIZED for 2s [ 1633.506694] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 241497b1-2809-46a0-8d59-95f9523f1e58 in Status: SUCCESS [ 1633.507221] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-241497b1-2809-46a0-8d59-95f9523f1e58" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1633.507221] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-241497b1-2809-46a0-8d59-95f9523f1e58" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1633.507303] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-241497b1-2809-46a0-8d59-95f9523f1e58" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1633.507438] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1633.507556] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1633.507617] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1633.507769] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1633.507853] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1633.507939] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-241497b1-2809-46a0-8d59-95f9523f1e58" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1633.508043] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('241497b1-2809-46a0-8d59-95f9523f1e58',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1634.009992] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('241497b1-2809-46a0-8d59-95f9523f1e58',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1634.512561] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 241497b1-2809-46a0-8d59-95f9523f1e58: rpc.has_security_group_logging(os_id): False [ 1634.529423] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1634.529608] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1634.529608] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1634.529819] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1634.529909] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1634.530153] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1634.530254] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1634.530317] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1634.530462] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1634.530537] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1634.530621] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 241497b1-2809-46a0-8d59-95f9523f1e58 is going to be created. [ 1634.585189] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1634.585346] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1634.585414] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1634.585527] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1634.585690] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1634.594491] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 241497b1-2809-46a0-8d59-95f9523f1e58 in Status: IN_PROGRESS for 2s [ 1634.951457] env[69188]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1634.951597] env[69188]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1636.606677] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 241497b1-2809-46a0-8d59-95f9523f1e58 in Status: SUCCESS [ 1636.607059] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-241497b1-2809-46a0-8d59-95f9523f1e58" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1639.952485] env[69188]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1639.952954] env[69188]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1644.953705] env[69188]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1644.954072] env[69188]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1649.954602] env[69188]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1649.954602] env[69188]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1654.955393] env[69188]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1654.955771] env[69188]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1659.956254] env[69188]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1659.956716] env[69188]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1664.957672] env[69188]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1664.958126] env[69188]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1669.958396] env[69188]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1669.958868] env[69188]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1674.959749] env[69188]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1674.960145] env[69188]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1679.960630] env[69188]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1679.960996] env[69188]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1684.961841] env[69188]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1684.962218] env[69188]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1689.962659] env[69188]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1689.963048] env[69188]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1694.963501] env[69188]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1694.963960] env[69188]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1699.965451] env[69188]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1699.965451] env[69188]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1704.966741] env[69188]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1704.966741] env[69188]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1709.968060] env[69188]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1709.968060] env[69188]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1714.969089] env[69188]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1714.969475] env[69188]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1719.970926] env[69188]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1719.971363] env[69188]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1724.972446] env[69188]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1724.972824] env[69188]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1729.973812] env[69188]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1729.974216] env[69188]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1734.975838] env[69188]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1734.975838] env[69188]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1739.977390] env[69188]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1739.977780] env[69188]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1744.978761] env[69188]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1744.979157] env[69188]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1749.980437] env[69188]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1749.980828] env[69188]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1754.981678] env[69188]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1754.983425] env[69188]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1759.982701] env[69188]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1759.983159] env[69188]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1760.214503] env[69188]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-ca0141f8-e0d0-45bb-94d3-6579b85b932c None None] NSXv3 Agent Agent loop - iteration:4 completed [ 1760.214708] env[69188]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-ca0141f8-e0d0-45bb-94d3-6579b85b932c None None] NSXv3 Agent Agent loop - iteration:5 started [ 1764.984912] env[69188]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1764.986683] env[69188]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1769.986707] env[69188]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1769.987129] env[69188]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1774.954526] env[69188]: INFO networking_nsxv3.common.synchronization [req-9643cb73-7de4-462f-bf96-4228af923202 req-8a05c820-8667-4d2a-b61d-6efde547b8b0 tempest-AttachVolumeTestJSON-519629187 tempest-AttachVolumeTestJSON-519629187-project-member] Enqueued Resource ID: 241497b1-2809-46a0-8d59-95f9523f1e58 with Priority: HIGHEST for action security_group_members [ 1774.955380] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 241497b1-2809-46a0-8d59-95f9523f1e58 with Priority: HIGHEST for action security_group_members [ 1774.955693] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-241497b1-2809-46a0-8d59-95f9523f1e58 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1774.955824] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-241497b1-2809-46a0-8d59-95f9523f1e58" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1774.956769] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-241497b1-2809-46a0-8d59-95f9523f1e58" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1774.956769] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-241497b1-2809-46a0-8d59-95f9523f1e58" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1774.956769] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1774.956769] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1774.956769] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1774.956769] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1774.956769] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1774.957134] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('241497b1-2809-46a0-8d59-95f9523f1e58',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1775.462029] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1775.462265] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1775.462265] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1775.462496] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1775.462643] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1775.462771] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1775.462867] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1775.462926] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1775.463079] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1775.463157] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1775.463245] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 241497b1-2809-46a0-8d59-95f9523f1e58 is going to be updated. [ 1775.499838] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1775.500032] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1775.500032] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1775.500201] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1775.500331] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1775.508723] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 241497b1-2809-46a0-8d59-95f9523f1e58 in Status: IN_PROGRESS for 2s [ 1777.519535] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 241497b1-2809-46a0-8d59-95f9523f1e58 in Status: SUCCESS [ 1777.519939] env[69188]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 241497b1-2809-46a0-8d59-95f9523f1e58 deletion is rescheduled due to dependency. [ 1777.519939] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-241497b1-2809-46a0-8d59-95f9523f1e58" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1779.633623] env[69188]: INFO networking_nsxv3.common.synchronization [None req-cd900ec9-f442-4afe-adef-81ca4761b99e tempest-AttachVolumeTestJSON-519629187 tempest-AttachVolumeTestJSON-519629187-project-member] Enqueued Resource ID: 57c5faf9-ee2e-4964-943f-bc73f230e7dc with Priority: HIGHEST for action security_group_rules [ 1779.634194] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57c5faf9-ee2e-4964-943f-bc73f230e7dc with Priority: HIGHEST for action security_group_rules [ 1779.634548] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-57c5faf9-ee2e-4964-943f-bc73f230e7dc taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1779.634662] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-57c5faf9-ee2e-4964-943f-bc73f230e7dc" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1779.634720] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-57c5faf9-ee2e-4964-943f-bc73f230e7dc" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1779.635274] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-57c5faf9-ee2e-4964-943f-bc73f230e7dc" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1779.635274] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('57c5faf9-ee2e-4964-943f-bc73f230e7dc',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1779.705967] env[69188]: INFO networking_nsxv3.common.synchronization [None req-4ae89cf0-5e4b-4209-a2bf-10a6d38c6b29 tempest-AttachVolumeTestJSON-519629187 tempest-AttachVolumeTestJSON-519629187-project-member] Enqueued Resource ID: 57c5faf9-ee2e-4964-943f-bc73f230e7dc with Priority: HIGHEST for action security_group_rules [ 1779.706438] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57c5faf9-ee2e-4964-943f-bc73f230e7dc with Priority: HIGHEST for action security_group_rules [ 1779.707042] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-57c5faf9-ee2e-4964-943f-bc73f230e7dc taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1779.707176] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-57c5faf9-ee2e-4964-943f-bc73f230e7dc" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1780.158458] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1780.158458] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1780.158458] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1780.158458] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1780.158458] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1780.158458] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 57c5faf9-ee2e-4964-943f-bc73f230e7dc already deleted. [ 1780.158826] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-57c5faf9-ee2e-4964-943f-bc73f230e7dc" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1780.158826] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-57c5faf9-ee2e-4964-943f-bc73f230e7dc" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1780.159560] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-57c5faf9-ee2e-4964-943f-bc73f230e7dc" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1780.159560] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('57c5faf9-ee2e-4964-943f-bc73f230e7dc',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1780.681065] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1780.681065] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1780.681065] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1780.681065] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1780.681612] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1780.681612] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 57c5faf9-ee2e-4964-943f-bc73f230e7dc already deleted. [ 1780.681612] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-57c5faf9-ee2e-4964-943f-bc73f230e7dc" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1784.162551] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1784.162941] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1784.162941] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1784.163131] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1784.163287] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1784.666043] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1784.707736] env[69188]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1784.707876] env[69188]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1784.870063] env[69188]: INFO networking_nsxv3.common.synchronization [req-459987f0-e6c0-4e1c-8cdc-75005cd55187 req-ac432847-8a5d-4a7d-aa2e-989730ee4157 tempest-AttachVolumeTestJSON-519629187 tempest-AttachVolumeTestJSON-519629187-project-member] Enqueued Resource ID: 57c5faf9-ee2e-4964-943f-bc73f230e7dc with Priority: HIGHEST for action security_group_members [ 1784.871025] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57c5faf9-ee2e-4964-943f-bc73f230e7dc with Priority: HIGHEST for action security_group_members [ 1784.871025] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-57c5faf9-ee2e-4964-943f-bc73f230e7dc taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1784.871025] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57c5faf9-ee2e-4964-943f-bc73f230e7dc" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1784.871025] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57c5faf9-ee2e-4964-943f-bc73f230e7dc" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1784.871307] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57c5faf9-ee2e-4964-943f-bc73f230e7dc" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1784.871471] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1784.871579] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1784.871640] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1784.871803] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1784.871888] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1784.871980] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('57c5faf9-ee2e-4964-943f-bc73f230e7dc',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1785.113440] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock network-94 taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1785.113653] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "network-94" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1785.113785] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "network-94" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1785.114082] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "network-94" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1785.114351] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1785.114517] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1785.114640] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1785.114858] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1785.115017] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1785.115257] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1785.115366] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] NeedRegenerationException {{(pid=69188) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1785.115479] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] no value, waiting for create lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1785.115593] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] value creation lock acquired {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1785.115697] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1785.115803] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Calling creation function for not-yet-present value {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1785.115937] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1785.135630] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1785.135795] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69188) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1785.135925] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Released creation lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1785.136104] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "network-94" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1785.136394] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock port-21d1f318-7d0f-4f24-8ec8-931bdb379b2f taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1785.136570] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "port-21d1f318-7d0f-4f24-8ec8-931bdb379b2f" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1785.136700] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "port-21d1f318-7d0f-4f24-8ec8-931bdb379b2f" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1785.136993] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "port-21d1f318-7d0f-4f24-8ec8-931bdb379b2f" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1785.137148] env[69188]: DEBUG networking_nsxv3.api.rpc [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('21d1f318-7d0f-4f24-8ec8-931bdb379b2f',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1785.167837] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1785.374229] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1785.374466] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1785.374548] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1785.374826] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1785.374992] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1785.375341] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1785.375554] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1785.375554] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1785.375791] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1785.375993] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1785.376144] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 57c5faf9-ee2e-4964-943f-bc73f230e7dc already deleted. [ 1785.376218] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57c5faf9-ee2e-4964-943f-bc73f230e7dc" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1785.640153] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1785.640452] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1785.640452] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1785.666533] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1785.666533] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1785.666533] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1785.666533] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Segment Port 21d1f318-7d0f-4f24-8ec8-931bdb379b2f not found, creating... [ 1785.666533] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1785.666533] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1785.666533] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1785.666533] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1785.666533] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1785.666533] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1785.668791] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1785.668791] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1785.668791] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1785.668791] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1785.668791] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Resource: SegmentPort with ID: 21d1f318-7d0f-4f24-8ec8-931bdb379b2f is going to be created. [ 1785.668791] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1785.668791] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1785.668791] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1785.668791] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1785.668791] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1785.668791] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "port-21d1f318-7d0f-4f24-8ec8-931bdb379b2f" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1785.670295] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1785.670422] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1786.328561] env[69188]: INFO networking_nsxv3.common.synchronization [req-459987f0-e6c0-4e1c-8cdc-75005cd55187 req-56135b06-de4c-4f05-96d1-92922c917791 service nova] Enqueued Resource ID: 57c5faf9-ee2e-4964-943f-bc73f230e7dc with Priority: HIGHEST for action security_group_rules [ 1786.328807] env[69188]: INFO networking_nsxv3.common.synchronization [req-459987f0-e6c0-4e1c-8cdc-75005cd55187 req-56135b06-de4c-4f05-96d1-92922c917791 service nova] Enqueued Resource ID: 57c5faf9-ee2e-4964-943f-bc73f230e7dc with Priority: HIGHEST for action security_group_members [ 1786.328919] env[69188]: INFO networking_nsxv3.common.synchronization [req-459987f0-e6c0-4e1c-8cdc-75005cd55187 req-56135b06-de4c-4f05-96d1-92922c917791 service nova] Enqueued Resource ID: 21d1f318-7d0f-4f24-8ec8-931bdb379b2f with Priority: HIGHEST for action port [ 1786.329130] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57c5faf9-ee2e-4964-943f-bc73f230e7dc with Priority: HIGHEST for action security_group_rules [ 1786.329259] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57c5faf9-ee2e-4964-943f-bc73f230e7dc with Priority: HIGHEST for action security_group_members [ 1786.329356] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 21d1f318-7d0f-4f24-8ec8-931bdb379b2f with Priority: HIGHEST for action port [ 1786.329899] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-57c5faf9-ee2e-4964-943f-bc73f230e7dc taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1786.330159] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-57c5faf9-ee2e-4964-943f-bc73f230e7dc" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1786.330254] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-57c5faf9-ee2e-4964-943f-bc73f230e7dc" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1786.330459] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-57c5faf9-ee2e-4964-943f-bc73f230e7dc" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1786.330543] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('57c5faf9-ee2e-4964-943f-bc73f230e7dc',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1786.331740] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-57c5faf9-ee2e-4964-943f-bc73f230e7dc taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1786.331995] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57c5faf9-ee2e-4964-943f-bc73f230e7dc" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1786.332061] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57c5faf9-ee2e-4964-943f-bc73f230e7dc" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1786.332222] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57c5faf9-ee2e-4964-943f-bc73f230e7dc" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1786.332373] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1786.332480] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1786.332540] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1786.332666] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1786.332751] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1786.333173] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('57c5faf9-ee2e-4964-943f-bc73f230e7dc',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1786.334498] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-21d1f318-7d0f-4f24-8ec8-931bdb379b2f taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1786.335649] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-21d1f318-7d0f-4f24-8ec8-931bdb379b2f" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1786.335649] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-21d1f318-7d0f-4f24-8ec8-931bdb379b2f" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1786.335649] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-21d1f318-7d0f-4f24-8ec8-931bdb379b2f" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1786.335649] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('21d1f318-7d0f-4f24-8ec8-931bdb379b2f',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1786.408702] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1786.408880] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1786.408938] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1786.409121] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1786.422628] env[69188]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1786.423485] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1786.424275] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1786.457339] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1786.457517] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1786.457612] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1786.457769] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1786.470701] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1786.471497] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1786.471580] env[69188]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=69188) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1786.471682] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1786.493429] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1786.493547] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1786.493602] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1786.493835] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1786.494147] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1786.494266] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1786.637784] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1786.637917] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1786.637991] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1786.638215] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1786.638525] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1786.638829] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1786.715055] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1786.715206] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1786.715258] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1786.715469] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1786.715744] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1786.715987] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:6. [ 1786.716085] env[69188]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'2fc127c1-64d5-4545-935d-5499e2e4234b', '614b9fd7-ab13-4673-ace1-c5f03c5b9acc', '241497b1-2809-46a0-8d59-95f9523f1e58', '4e9db3bb-e903-42d7-b7e6-e365ea0c7f5f', '24a7b083-b432-46d6-94de-76adf6ce22b3', 'e275bda6-f504-45ea-9805-84ac49a67aa7'} {{(pid=69188) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1786.716161] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1786.734655] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1786.734767] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1786.734816] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1786.734984] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1786.735077] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1786.735172] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1786.735241] env[69188]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=69188) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1786.735310] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1786.801971] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1786.802114] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1786.802190] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1786.802369] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1786.803397] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1786.803626] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1786.803702] env[69188]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=69188) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1786.803773] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1786.803838] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1786.803914] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 6/6 resources of Type:Security Group Rules [ 1786.803986] env[69188]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 2fc127c1-64d5-4545-935d-5499e2e4234b with Priority: HIGH for action security_group_rules [ 1786.804080] env[69188]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 614b9fd7-ab13-4673-ace1-c5f03c5b9acc with Priority: HIGH for action security_group_rules [ 1786.804147] env[69188]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 241497b1-2809-46a0-8d59-95f9523f1e58 with Priority: HIGH for action security_group_rules [ 1786.804211] env[69188]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 4e9db3bb-e903-42d7-b7e6-e365ea0c7f5f with Priority: HIGH for action security_group_rules [ 1786.804271] env[69188]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 24a7b083-b432-46d6-94de-76adf6ce22b3 with Priority: HIGH for action security_group_rules [ 1786.804557] env[69188]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e275bda6-f504-45ea-9805-84ac49a67aa7 with Priority: HIGH for action security_group_rules [ 1786.804557] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Members [ 1786.804557] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:QoS [ 1786.804665] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1786.804718] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1786.804780] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1786.804915] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1786.804991] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1786.805168] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1786.805252] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1786.805309] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1786.805462] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1786.805537] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1786.805702] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1786.805789] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1786.805845] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1786.805978] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1786.806059] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1786.806219] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1786.806306] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1786.806363] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1786.806494] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1786.806700] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1786.806752] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1786.806795] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1786.806869] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1786.806982] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1786.807061] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1786.807220] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1786.807302] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1786.807362] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1786.807515] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1786.807588] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1786.807768] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1786.807835] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1786.807905] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1786.808048] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1786.808110] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1786.808244] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1786.808326] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1786.808382] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1786.808514] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1786.808586] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1786.808781] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1786.808847] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1786.808881] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1786.809010] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1786.809084] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1786.809241] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1786.809328] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1786.809388] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1786.809518] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1786.809587] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1786.809761] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1786.809854] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1786.809910] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1786.810077] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1786.810136] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1786.810284] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1786.810372] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1786.810440] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1786.810565] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1786.810675] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1786.810855] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1786.810957] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1786.811015] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1786.811133] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1786.811204] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1786.811363] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1786.811451] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1786.811504] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1786.811634] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1786.811745] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1786.811860] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1786.811946] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1786.812023] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1786.812144] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1786.812213] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1786.812373] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1786.812461] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1786.812517] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1786.812643] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1786.812714] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1786.812871] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1786.812958] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1786.813027] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1786.813159] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1786.813229] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1786.813389] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1786.813477] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1786.813542] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1786.813663] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1786.813731] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1786.813887] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1786.813973] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1786.814029] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1786.814161] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1786.814230] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1786.814389] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1786.814477] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1786.814535] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1786.814661] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1786.814730] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1786.814886] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1786.814972] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1786.815054] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1786.815176] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1786.815236] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1786.815411] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1786.815504] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1786.815562] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1786.815694] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1786.815764] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1786.815923] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1786.816019] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1786.816078] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1786.816349] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1786.816349] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1786.816424] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1786.816525] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1786.816597] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1786.816695] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1786.816764] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1786.816921] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1786.817022] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1786.817079] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1786.817206] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1786.817275] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1786.817468] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1786.817556] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1786.817617] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1786.817749] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1786.817820] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1786.817981] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1786.818081] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1786.818140] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1786.818269] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1786.818339] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1786.818501] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1786.818587] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1786.818645] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1786.818772] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1786.818842] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1786.819008] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1786.819100] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1786.819158] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1786.819294] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1786.819405] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1786.819586] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1786.819677] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1786.819736] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1786.819868] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1786.819999] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1786.820184] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1786.820279] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1786.820338] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1786.820471] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1786.820543] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1786.820783] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1786.820901] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1786.820964] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1786.821117] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1786.821192] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1786.821356] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1786.821447] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1786.821507] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1786.821638] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1786.821709] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1786.821870] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1786.821958] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1786.822026] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1786.822161] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1786.822232] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1786.822393] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1786.822481] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1786.822539] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1786.822668] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1786.822738] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1786.822897] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1786.822983] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1786.823052] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1786.823183] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1786.823254] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1786.823412] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1786.823499] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1786.823557] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1786.823685] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1786.823754] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1786.823913] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1786.823997] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1786.824064] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1786.824194] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1786.824264] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1786.824423] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1786.824511] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1786.824569] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1786.824695] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1786.824765] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1786.824922] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1786.825015] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1786.825077] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1786.825206] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1786.825308] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1786.825453] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1786.825544] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1786.825602] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1786.825732] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1786.825802] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1786.825961] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1786.826077] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1786.826137] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1786.826269] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1786.826339] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1786.826500] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1786.826587] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1786.826646] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1786.826774] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1786.826843] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1786.827015] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1786.827106] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1786.827164] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1786.827294] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1786.827365] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1786.827550] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1786.827641] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1786.827700] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1786.827831] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1786.827902] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1786.828074] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1786.828162] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1786.828255] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1786.828347] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1786.828418] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1786.828577] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1786.828664] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1786.828721] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1786.828849] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1786.828919] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1786.829089] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1786.829178] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1786.829236] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1786.829366] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1786.829436] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1786.829594] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1786.829703] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1786.829751] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1786.829885] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1786.829957] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1786.830132] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1786.830221] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1786.830279] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1786.830409] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1786.830513] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1786.830638] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1786.830722] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1786.830779] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1786.830907] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1786.830978] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1786.831150] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1786.831239] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1786.831298] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1786.831426] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1786.831498] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1786.831655] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1786.831743] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1786.831801] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1786.831928] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1786.831999] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1786.832170] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1786.832259] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1786.832317] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1786.832445] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1786.832519] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1786.832677] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1786.832763] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1786.832822] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1786.832948] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1786.833029] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1786.833190] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1786.833276] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1786.833334] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1786.833463] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1786.833537] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1786.833698] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1786.833775] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1786.833828] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1786.833953] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1786.834120] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1786.834192] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1786.834277] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1786.834335] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1786.834464] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1786.834535] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1786.834692] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1786.834777] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1786.834833] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1786.835133] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1786.835133] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1786.835186] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1786.835259] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1786.835316] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1786.835462] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1786.835538] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1786.835699] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1786.835786] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1786.835845] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1786.835974] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1786.836057] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1786.836217] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1786.836304] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1786.836361] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1786.836489] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1786.836560] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1786.836717] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1786.836801] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1786.836858] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1786.836985] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1786.837063] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1786.837222] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1786.837310] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1786.837367] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1786.837515] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1786.837584] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1786.837746] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1786.837831] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1786.837886] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1786.838023] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1786.838091] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1786.838196] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Items outdated since last Agent sanitize:0 [ 1786.838248] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Sanitizing provider based on age cycles [ 1786.838352] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1786.839282] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-57c5faf9-ee2e-4964-943f-bc73f230e7dc taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1786.839386] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57c5faf9-ee2e-4964-943f-bc73f230e7dc" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1786.839548] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('57c5faf9-ee2e-4964-943f-bc73f230e7dc',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1786.840350] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 21d1f318-7d0f-4f24-8ec8-931bdb379b2f with status ACTIVE [ 1786.840515] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1786.840618] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1786.840684] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1786.840831] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1786.840910] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1786.841079] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1786.841170] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1786.841490] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1786.841490] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1786.841490] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1786.841648] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1786.841706] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1786.841732] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1786.841845] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1786.841912] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1786.841994] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 21d1f318-7d0f-4f24-8ec8-931bdb379b2f is going to be updated. [ 1786.864058] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1786.864186] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1786.864268] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1786.864409] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1786.864538] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1786.864682] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-21d1f318-7d0f-4f24-8ec8-931bdb379b2f" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1786.907396] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1786.907565] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1786.907565] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1786.907732] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1786.908018] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1786.908253] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1786.978310] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1786.978475] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1786.978510] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1786.978691] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1786.978973] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1787.004040] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1787.346163] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('57c5faf9-ee2e-4964-943f-bc73f230e7dc',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1787.847702] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1787.847900] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1787.847936] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1787.848265] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1787.848362] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1787.848502] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 57c5faf9-ee2e-4964-943f-bc73f230e7dc is going to be created. [ 1787.870691] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1787.870691] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1787.870861] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1787.870959] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1787.871099] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1787.879016] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 57c5faf9-ee2e-4964-943f-bc73f230e7dc in Status: UNINITIALIZED for 2s [ 1789.889707] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 57c5faf9-ee2e-4964-943f-bc73f230e7dc in Status: SUCCESS [ 1789.890065] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57c5faf9-ee2e-4964-943f-bc73f230e7dc" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1789.890101] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57c5faf9-ee2e-4964-943f-bc73f230e7dc" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1789.890312] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57c5faf9-ee2e-4964-943f-bc73f230e7dc" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1789.890503] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1789.890621] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1789.890685] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1789.890834] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1789.890912] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1789.890993] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57c5faf9-ee2e-4964-943f-bc73f230e7dc" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1789.891100] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('57c5faf9-ee2e-4964-943f-bc73f230e7dc',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1790.393519] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('57c5faf9-ee2e-4964-943f-bc73f230e7dc',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1790.896404] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 57c5faf9-ee2e-4964-943f-bc73f230e7dc: rpc.has_security_group_logging(os_id): False [ 1790.913746] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1790.913880] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1790.913941] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1790.914156] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1790.914247] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1790.914517] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1790.914604] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1790.914667] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1790.914817] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1790.914896] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1790.914981] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 57c5faf9-ee2e-4964-943f-bc73f230e7dc is going to be created. [ 1790.980476] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1790.980640] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1790.980697] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1790.980858] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1790.981041] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1790.991042] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 57c5faf9-ee2e-4964-943f-bc73f230e7dc in Status: IN_PROGRESS for 2s [ 1791.331028] env[69188]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1791.331168] env[69188]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=6], Jobs=1 [ 1791.331357] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2fc127c1-64d5-4545-935d-5499e2e4234b with Priority: HIGH for action security_group_rules [ 1791.331524] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 241497b1-2809-46a0-8d59-95f9523f1e58 with Priority: HIGH for action security_group_rules [ 1791.331657] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e275bda6-f504-45ea-9805-84ac49a67aa7 with Priority: HIGH for action security_group_rules [ 1791.331778] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 24a7b083-b432-46d6-94de-76adf6ce22b3 with Priority: HIGH for action security_group_rules [ 1791.331898] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 614b9fd7-ab13-4673-ace1-c5f03c5b9acc with Priority: HIGH for action security_group_rules [ 1791.332044] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e9db3bb-e903-42d7-b7e6-e365ea0c7f5f with Priority: HIGH for action security_group_rules [ 1791.332419] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2fc127c1-64d5-4545-935d-5499e2e4234b taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1791.332559] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2fc127c1-64d5-4545-935d-5499e2e4234b" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1791.332652] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2fc127c1-64d5-4545-935d-5499e2e4234b" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1791.332843] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2fc127c1-64d5-4545-935d-5499e2e4234b" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1791.332925] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2fc127c1-64d5-4545-935d-5499e2e4234b',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1791.333918] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-241497b1-2809-46a0-8d59-95f9523f1e58 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1791.334046] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-241497b1-2809-46a0-8d59-95f9523f1e58" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1791.334117] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-241497b1-2809-46a0-8d59-95f9523f1e58" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1791.334285] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-241497b1-2809-46a0-8d59-95f9523f1e58" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1791.334360] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('241497b1-2809-46a0-8d59-95f9523f1e58',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1791.335113] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e275bda6-f504-45ea-9805-84ac49a67aa7 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1791.335224] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e275bda6-f504-45ea-9805-84ac49a67aa7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1791.335286] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e275bda6-f504-45ea-9805-84ac49a67aa7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1791.335483] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e275bda6-f504-45ea-9805-84ac49a67aa7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1791.335557] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e275bda6-f504-45ea-9805-84ac49a67aa7',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1791.336552] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-24a7b083-b432-46d6-94de-76adf6ce22b3 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1791.336666] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-24a7b083-b432-46d6-94de-76adf6ce22b3" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1791.336928] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-24a7b083-b432-46d6-94de-76adf6ce22b3" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1791.336928] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-24a7b083-b432-46d6-94de-76adf6ce22b3" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1791.336976] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('24a7b083-b432-46d6-94de-76adf6ce22b3',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1791.337656] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-614b9fd7-ab13-4673-ace1-c5f03c5b9acc taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1791.337764] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-614b9fd7-ab13-4673-ace1-c5f03c5b9acc" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1791.337831] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-614b9fd7-ab13-4673-ace1-c5f03c5b9acc" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1791.337979] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-614b9fd7-ab13-4673-ace1-c5f03c5b9acc" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1791.338065] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('614b9fd7-ab13-4673-ace1-c5f03c5b9acc',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1791.338956] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4e9db3bb-e903-42d7-b7e6-e365ea0c7f5f taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1791.338956] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4e9db3bb-e903-42d7-b7e6-e365ea0c7f5f" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1791.338956] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4e9db3bb-e903-42d7-b7e6-e365ea0c7f5f" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1791.339103] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4e9db3bb-e903-42d7-b7e6-e365ea0c7f5f" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1791.339176] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4e9db3bb-e903-42d7-b7e6-e365ea0c7f5f',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1791.873494] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1791.873684] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1791.873727] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1791.873906] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1791.875337] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1791.875447] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1791.876105] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1791.876202] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1791.876828] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1791.876923] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1791.877638] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1791.877727] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1791.878404] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1791.878493] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1791.892297] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1791.892403] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 614b9fd7-ab13-4673-ace1-c5f03c5b9acc is going to be deleted. [ 1791.893101] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1791.893285] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1791.908568] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1791.908822] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2fc127c1-64d5-4545-935d-5499e2e4234b is going to be deleted. [ 1791.909357] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1791.909531] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1791.922159] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1791.922254] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e275bda6-f504-45ea-9805-84ac49a67aa7 is going to be deleted. [ 1791.922920] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1791.923104] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1791.940183] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1791.940278] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 24a7b083-b432-46d6-94de-76adf6ce22b3 is going to be deleted. [ 1791.940944] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1791.941129] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1791.959189] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1791.959314] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1791.960409] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1791.960506] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1791.963210] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1791.963289] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1791.964010] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1791.964123] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 241497b1-2809-46a0-8d59-95f9523f1e58 is going to be deleted. [ 1791.964787] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1791.964951] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1792.006761] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1792.006866] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4e9db3bb-e903-42d7-b7e6-e365ea0c7f5f is going to be deleted. [ 1792.007602] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1792.007769] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1792.007855] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1792.007969] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2fc127c1-64d5-4545-935d-5499e2e4234b" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1792.008133] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1792.008280] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1792.008359] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1792.008478] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-614b9fd7-ab13-4673-ace1-c5f03c5b9acc" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1792.008873] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1792.009044] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1792.009127] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1792.009226] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e275bda6-f504-45ea-9805-84ac49a67aa7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1792.032989] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1792.033123] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1792.033191] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1792.033344] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1792.033425] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1792.033533] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-24a7b083-b432-46d6-94de-76adf6ce22b3" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1792.062962] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1792.063086] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1792.063162] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1792.063316] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1792.063396] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1792.063502] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-241497b1-2809-46a0-8d59-95f9523f1e58" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1792.111951] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1792.112088] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1792.112138] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1792.112303] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1792.112383] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1792.112490] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4e9db3bb-e903-42d7-b7e6-e365ea0c7f5f" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1793.002226] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 57c5faf9-ee2e-4964-943f-bc73f230e7dc in Status: SUCCESS [ 1793.002594] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-57c5faf9-ee2e-4964-943f-bc73f230e7dc" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1796.333057] env[69188]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1796.333374] env[69188]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1801.333998] env[69188]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1801.334372] env[69188]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1806.334903] env[69188]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1806.335327] env[69188]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1811.336600] env[69188]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1811.336600] env[69188]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1816.337704] env[69188]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1816.338109] env[69188]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1821.338341] env[69188]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1821.338804] env[69188]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1826.339993] env[69188]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1826.340332] env[69188]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1831.341433] env[69188]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1831.341643] env[69188]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1836.342870] env[69188]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1836.343264] env[69188]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1841.344230] env[69188]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1841.344566] env[69188]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1846.345564] env[69188]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1846.345900] env[69188]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1851.346556] env[69188]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1851.346982] env[69188]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1856.347827] env[69188]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1856.348226] env[69188]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1860.688186] env[69188]: INFO networking_nsxv3.common.synchronization [req-a542a0bf-2a3c-49a4-b0ee-2fd72472c39f req-55af986c-1ea5-4254-aeb6-656170862849 tempest-AttachVolumeTestJSON-519629187 tempest-AttachVolumeTestJSON-519629187-project-member] Enqueued Resource ID: 57c5faf9-ee2e-4964-943f-bc73f230e7dc with Priority: HIGHEST for action security_group_members [ 1860.688744] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57c5faf9-ee2e-4964-943f-bc73f230e7dc with Priority: HIGHEST for action security_group_members [ 1860.689108] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-57c5faf9-ee2e-4964-943f-bc73f230e7dc taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1860.689255] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57c5faf9-ee2e-4964-943f-bc73f230e7dc" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1860.689341] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57c5faf9-ee2e-4964-943f-bc73f230e7dc" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1860.689539] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57c5faf9-ee2e-4964-943f-bc73f230e7dc" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1860.690397] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1860.690397] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1860.690397] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1860.690397] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1860.690397] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1860.690397] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('57c5faf9-ee2e-4964-943f-bc73f230e7dc',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1861.192403] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1861.192577] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1861.192683] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1861.192861] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1861.192960] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1861.193210] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1861.193303] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1861.193371] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1861.193522] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1861.193600] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1861.193687] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 57c5faf9-ee2e-4964-943f-bc73f230e7dc is going to be updated. [ 1861.228501] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1861.228644] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1861.228689] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1861.228830] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1861.228963] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1861.238193] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 57c5faf9-ee2e-4964-943f-bc73f230e7dc in Status: IN_PROGRESS for 2s [ 1863.249079] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 57c5faf9-ee2e-4964-943f-bc73f230e7dc in Status: SUCCESS [ 1863.249410] env[69188]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 57c5faf9-ee2e-4964-943f-bc73f230e7dc deletion is rescheduled due to dependency. [ 1863.249410] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57c5faf9-ee2e-4964-943f-bc73f230e7dc" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1865.690073] env[69188]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1865.690073] env[69188]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1870.691233] env[69188]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1870.691531] env[69188]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1875.532170] env[69188]: INFO networking_nsxv3.common.synchronization [None req-8575a585-7813-4bc3-b913-780fa66e4b50 None None] Enqueued Resource ID: 98d9c509-21b0-4d13-8825-7ac2d338a588 with Priority: HIGHEST for action port [ 1875.532474] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 98d9c509-21b0-4d13-8825-7ac2d338a588 with Priority: HIGHEST for action port [ 1875.533034] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-98d9c509-21b0-4d13-8825-7ac2d338a588 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1875.533175] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-98d9c509-21b0-4d13-8825-7ac2d338a588" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1875.533247] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-98d9c509-21b0-4d13-8825-7ac2d338a588" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1875.533530] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-98d9c509-21b0-4d13-8825-7ac2d338a588" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1875.533614] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('98d9c509-21b0-4d13-8825-7ac2d338a588',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1876.039431] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 98d9c509-21b0-4d13-8825-7ac2d338a588 [ 1876.039656] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1876.039838] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1876.039895] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1876.040088] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1876.040187] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1876.040284] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:98d9c509-21b0-4d13-8825-7ac2d338a588 already deleted. [ 1876.040363] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-98d9c509-21b0-4d13-8825-7ac2d338a588" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1876.311869] env[69188]: INFO networking_nsxv3.common.synchronization [None req-4020b304-92b7-4af0-82d8-272dd3fea86e tempest-AttachVolumeNegativeTest-710486423 tempest-AttachVolumeNegativeTest-710486423-project-member] Enqueued Resource ID: 61518cd2-637a-4fec-b890-2b6ae31ab7eb with Priority: HIGHEST for action security_group_rules [ 1876.312411] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 61518cd2-637a-4fec-b890-2b6ae31ab7eb with Priority: HIGHEST for action security_group_rules [ 1876.312721] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-61518cd2-637a-4fec-b890-2b6ae31ab7eb taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1876.312846] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-61518cd2-637a-4fec-b890-2b6ae31ab7eb" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1876.312915] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-61518cd2-637a-4fec-b890-2b6ae31ab7eb" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1876.313191] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-61518cd2-637a-4fec-b890-2b6ae31ab7eb" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1876.313275] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('61518cd2-637a-4fec-b890-2b6ae31ab7eb',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1876.382754] env[69188]: INFO networking_nsxv3.common.synchronization [None req-49fa3f80-16bc-4728-8d73-d571096fa649 tempest-AttachVolumeNegativeTest-710486423 tempest-AttachVolumeNegativeTest-710486423-project-member] Enqueued Resource ID: 61518cd2-637a-4fec-b890-2b6ae31ab7eb with Priority: HIGHEST for action security_group_rules [ 1876.383319] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 61518cd2-637a-4fec-b890-2b6ae31ab7eb with Priority: HIGHEST for action security_group_rules [ 1876.383624] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-61518cd2-637a-4fec-b890-2b6ae31ab7eb taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1876.383730] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-61518cd2-637a-4fec-b890-2b6ae31ab7eb" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1876.833224] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1876.833513] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1876.833513] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1876.833683] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1876.833777] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1876.833879] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 61518cd2-637a-4fec-b890-2b6ae31ab7eb already deleted. [ 1876.833982] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-61518cd2-637a-4fec-b890-2b6ae31ab7eb" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1876.834143] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-61518cd2-637a-4fec-b890-2b6ae31ab7eb" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1876.834305] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-61518cd2-637a-4fec-b890-2b6ae31ab7eb" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1876.834391] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('61518cd2-637a-4fec-b890-2b6ae31ab7eb',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1877.354124] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1877.354280] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1877.354345] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1877.354559] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1877.354640] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1877.354734] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 61518cd2-637a-4fec-b890-2b6ae31ab7eb already deleted. [ 1877.354814] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-61518cd2-637a-4fec-b890-2b6ae31ab7eb" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1877.549772] env[69188]: INFO networking_nsxv3.common.synchronization [None req-43311c17-896b-4897-b68e-5f86599c7d74 None None] Enqueued Resource ID: 6e83a68d-a54e-4b82-abb8-4030399662a5 with Priority: HIGHEST for action port [ 1877.549772] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e83a68d-a54e-4b82-abb8-4030399662a5 with Priority: HIGHEST for action port [ 1877.550238] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-6e83a68d-a54e-4b82-abb8-4030399662a5 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1877.550388] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6e83a68d-a54e-4b82-abb8-4030399662a5" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1877.550463] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6e83a68d-a54e-4b82-abb8-4030399662a5" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1877.550746] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6e83a68d-a54e-4b82-abb8-4030399662a5" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1877.550833] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6e83a68d-a54e-4b82-abb8-4030399662a5',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1878.053915] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6e83a68d-a54e-4b82-abb8-4030399662a5 [ 1878.054188] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1878.054425] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1878.054425] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1878.054563] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1878.054651] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1878.054750] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6e83a68d-a54e-4b82-abb8-4030399662a5 already deleted. [ 1878.054828] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6e83a68d-a54e-4b82-abb8-4030399662a5" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1881.665110] env[69188]: INFO networking_nsxv3.common.synchronization [req-fdf8f299-6427-4ba7-845b-df9691a32f25 req-5071a939-9ade-4661-804c-e5824ade20de tempest-AttachVolumeNegativeTest-710486423 tempest-AttachVolumeNegativeTest-710486423-project-member] Enqueued Resource ID: 61518cd2-637a-4fec-b890-2b6ae31ab7eb with Priority: HIGHEST for action security_group_members [ 1881.666029] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 61518cd2-637a-4fec-b890-2b6ae31ab7eb with Priority: HIGHEST for action security_group_members [ 1881.666029] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-61518cd2-637a-4fec-b890-2b6ae31ab7eb taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1881.666187] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-61518cd2-637a-4fec-b890-2b6ae31ab7eb" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1881.666187] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-61518cd2-637a-4fec-b890-2b6ae31ab7eb" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1881.667154] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-61518cd2-637a-4fec-b890-2b6ae31ab7eb" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1881.667154] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1881.667154] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1881.667154] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1881.667154] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1881.667154] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1881.667154] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('61518cd2-637a-4fec-b890-2b6ae31ab7eb',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1881.944054] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock network-655 taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1881.945038] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "network-655" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1881.945038] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "network-655" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1881.945038] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "network-655" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1881.945254] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1881.945354] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1881.945533] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1881.945822] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1881.946017] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1881.946289] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1881.946445] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] NeedRegenerationException {{(pid=69188) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1881.946569] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] no value, waiting for create lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1881.946709] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] value creation lock acquired {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1881.946858] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1881.946999] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Calling creation function for not-yet-present value {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1881.947166] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1881.967749] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1881.967926] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69188) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1881.969048] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Released creation lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1881.969048] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "network-655" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1881.969048] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock port-269618e5-587d-44f0-98d1-89c15ccbac80 taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1881.969048] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "port-269618e5-587d-44f0-98d1-89c15ccbac80" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1881.969048] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "port-269618e5-587d-44f0-98d1-89c15ccbac80" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1881.969369] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "port-269618e5-587d-44f0-98d1-89c15ccbac80" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1881.969492] env[69188]: DEBUG networking_nsxv3.api.rpc [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('269618e5-587d-44f0-98d1-89c15ccbac80',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1882.168815] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1882.168991] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1882.169052] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1882.169255] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1882.169351] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1882.169552] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1882.169651] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1882.169714] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1882.169870] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1882.169946] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1882.170051] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 61518cd2-637a-4fec-b890-2b6ae31ab7eb already deleted. [ 1882.170135] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-61518cd2-637a-4fec-b890-2b6ae31ab7eb" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1882.472193] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1882.472430] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1882.472564] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1882.472847] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1882.473015] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1882.473182] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Segment Port 269618e5-587d-44f0-98d1-89c15ccbac80 not found, creating... [ 1882.473459] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1882.473620] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1882.473769] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1882.473999] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1882.474160] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1882.474450] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1882.474614] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1882.474735] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1882.474941] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1882.475092] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1882.475236] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Resource: SegmentPort with ID: 269618e5-587d-44f0-98d1-89c15ccbac80 is going to be created. [ 1882.502036] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1882.502250] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1882.502382] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1882.502623] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1882.502859] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1882.503100] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "port-269618e5-587d-44f0-98d1-89c15ccbac80" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1883.155624] env[69188]: INFO networking_nsxv3.common.synchronization [req-fdf8f299-6427-4ba7-845b-df9691a32f25 req-fff6fff2-5f72-4e14-bf59-0e38fea501ba service nova] Enqueued Resource ID: 61518cd2-637a-4fec-b890-2b6ae31ab7eb with Priority: HIGHEST for action security_group_rules [ 1883.155885] env[69188]: INFO networking_nsxv3.common.synchronization [req-fdf8f299-6427-4ba7-845b-df9691a32f25 req-fff6fff2-5f72-4e14-bf59-0e38fea501ba service nova] Enqueued Resource ID: 61518cd2-637a-4fec-b890-2b6ae31ab7eb with Priority: HIGHEST for action security_group_members [ 1883.155970] env[69188]: INFO networking_nsxv3.common.synchronization [req-fdf8f299-6427-4ba7-845b-df9691a32f25 req-fff6fff2-5f72-4e14-bf59-0e38fea501ba service nova] Enqueued Resource ID: 269618e5-587d-44f0-98d1-89c15ccbac80 with Priority: HIGHEST for action port [ 1883.156221] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 61518cd2-637a-4fec-b890-2b6ae31ab7eb with Priority: HIGHEST for action security_group_rules [ 1883.156353] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 61518cd2-637a-4fec-b890-2b6ae31ab7eb with Priority: HIGHEST for action security_group_members [ 1883.156451] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 269618e5-587d-44f0-98d1-89c15ccbac80 with Priority: HIGHEST for action port [ 1883.156983] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-61518cd2-637a-4fec-b890-2b6ae31ab7eb taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1883.157114] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-61518cd2-637a-4fec-b890-2b6ae31ab7eb" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1883.157184] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-61518cd2-637a-4fec-b890-2b6ae31ab7eb" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1883.157392] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-61518cd2-637a-4fec-b890-2b6ae31ab7eb" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1883.157463] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('61518cd2-637a-4fec-b890-2b6ae31ab7eb',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1883.158738] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-61518cd2-637a-4fec-b890-2b6ae31ab7eb taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1883.158850] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-61518cd2-637a-4fec-b890-2b6ae31ab7eb" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1883.158919] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-61518cd2-637a-4fec-b890-2b6ae31ab7eb" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1883.159102] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-61518cd2-637a-4fec-b890-2b6ae31ab7eb" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1883.159253] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1883.159340] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1883.159400] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1883.159542] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1883.159622] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1883.159710] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('61518cd2-637a-4fec-b890-2b6ae31ab7eb',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1883.160433] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-269618e5-587d-44f0-98d1-89c15ccbac80 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1883.160559] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-269618e5-587d-44f0-98d1-89c15ccbac80" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1883.160626] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-269618e5-587d-44f0-98d1-89c15ccbac80" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1883.160754] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-269618e5-587d-44f0-98d1-89c15ccbac80" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1883.161085] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('269618e5-587d-44f0-98d1-89c15ccbac80',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1883.663091] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-61518cd2-637a-4fec-b890-2b6ae31ab7eb taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1883.663238] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-61518cd2-637a-4fec-b890-2b6ae31ab7eb" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1883.663429] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('61518cd2-637a-4fec-b890-2b6ae31ab7eb',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1883.664328] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 269618e5-587d-44f0-98d1-89c15ccbac80 with status ACTIVE [ 1883.664555] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1883.664608] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1883.664662] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1883.664853] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1883.664947] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1883.665147] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1883.665226] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1883.665274] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1883.665467] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1883.665555] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1883.665896] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1883.665896] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1883.665896] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1883.666035] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1883.666094] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1883.666176] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 269618e5-587d-44f0-98d1-89c15ccbac80 is going to be updated. [ 1883.687390] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1883.687506] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1883.687573] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1883.687720] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1883.687841] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1883.687985] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-269618e5-587d-44f0-98d1-89c15ccbac80" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1884.168442] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('61518cd2-637a-4fec-b890-2b6ae31ab7eb',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1884.670439] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1884.670631] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1884.670741] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1884.670963] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1884.671078] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1884.671177] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 61518cd2-637a-4fec-b890-2b6ae31ab7eb is going to be created. [ 1884.696582] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1884.696706] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1884.696771] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1884.696972] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1884.697141] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1884.706222] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 61518cd2-637a-4fec-b890-2b6ae31ab7eb in Status: UNINITIALIZED for 2s [ 1886.716048] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 61518cd2-637a-4fec-b890-2b6ae31ab7eb in Status: SUCCESS [ 1886.716048] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-61518cd2-637a-4fec-b890-2b6ae31ab7eb" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1886.716416] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-61518cd2-637a-4fec-b890-2b6ae31ab7eb" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1886.716416] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-61518cd2-637a-4fec-b890-2b6ae31ab7eb" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1886.716528] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1886.716636] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1886.716704] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1886.716882] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1886.716970] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1886.717070] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-61518cd2-637a-4fec-b890-2b6ae31ab7eb" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1886.717163] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('61518cd2-637a-4fec-b890-2b6ae31ab7eb',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1887.219768] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('61518cd2-637a-4fec-b890-2b6ae31ab7eb',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1887.722582] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 61518cd2-637a-4fec-b890-2b6ae31ab7eb: rpc.has_security_group_logging(os_id): False [ 1887.739521] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1887.739641] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1887.739720] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1887.739926] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1887.740032] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1887.740282] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1887.740385] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1887.740448] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1887.740604] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1887.740682] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1887.740769] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 61518cd2-637a-4fec-b890-2b6ae31ab7eb is going to be created. [ 1887.796575] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1887.796729] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1887.796772] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1887.796941] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1887.797130] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1887.807591] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 61518cd2-637a-4fec-b890-2b6ae31ab7eb in Status: IN_PROGRESS for 2s [ 1888.157852] env[69188]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1888.158048] env[69188]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1889.821606] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 61518cd2-637a-4fec-b890-2b6ae31ab7eb in Status: SUCCESS [ 1889.821861] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-61518cd2-637a-4fec-b890-2b6ae31ab7eb" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1893.159757] env[69188]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1893.160110] env[69188]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1898.160661] env[69188]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1898.161029] env[69188]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1903.162294] env[69188]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1903.162678] env[69188]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1908.163733] env[69188]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1908.164156] env[69188]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1913.164891] env[69188]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1913.165253] env[69188]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1918.166162] env[69188]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1918.166613] env[69188]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1923.167954] env[69188]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1923.168354] env[69188]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1928.169374] env[69188]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1928.169767] env[69188]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1933.170380] env[69188]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1933.170756] env[69188]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1936.211555] env[69188]: INFO networking_nsxv3.common.synchronization [None req-145cf3a8-800b-41a4-88d1-c2d2a592855b tempest-AttachVolumeNegativeTest-710486423 tempest-AttachVolumeNegativeTest-710486423-project-member] Enqueued Resource ID: fab0830f-bae0-4a7a-851f-02ab1abad4a8 with Priority: HIGHEST for action security_group_rules [ 1936.212142] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fab0830f-bae0-4a7a-851f-02ab1abad4a8 with Priority: HIGHEST for action security_group_rules [ 1936.212446] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fab0830f-bae0-4a7a-851f-02ab1abad4a8 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1936.212568] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fab0830f-bae0-4a7a-851f-02ab1abad4a8" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1936.212630] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fab0830f-bae0-4a7a-851f-02ab1abad4a8" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1936.212881] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fab0830f-bae0-4a7a-851f-02ab1abad4a8" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1936.212964] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fab0830f-bae0-4a7a-851f-02ab1abad4a8',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1936.277095] env[69188]: INFO networking_nsxv3.common.synchronization [None req-15ecc55d-5d87-4732-92a4-73ad59680af4 tempest-AttachVolumeNegativeTest-710486423 tempest-AttachVolumeNegativeTest-710486423-project-member] Enqueued Resource ID: fab0830f-bae0-4a7a-851f-02ab1abad4a8 with Priority: HIGHEST for action security_group_rules [ 1936.277571] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fab0830f-bae0-4a7a-851f-02ab1abad4a8 with Priority: HIGHEST for action security_group_rules [ 1936.277887] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fab0830f-bae0-4a7a-851f-02ab1abad4a8 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1936.277997] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fab0830f-bae0-4a7a-851f-02ab1abad4a8" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1936.732759] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1936.732917] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1936.733110] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1936.733261] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1936.733355] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1936.733456] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fab0830f-bae0-4a7a-851f-02ab1abad4a8 already deleted. [ 1936.733538] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fab0830f-bae0-4a7a-851f-02ab1abad4a8" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1936.733681] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fab0830f-bae0-4a7a-851f-02ab1abad4a8" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1936.733838] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fab0830f-bae0-4a7a-851f-02ab1abad4a8" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1936.733924] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fab0830f-bae0-4a7a-851f-02ab1abad4a8',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1937.259808] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1937.260169] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1937.260169] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1937.260227] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1937.260319] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1937.260368] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fab0830f-bae0-4a7a-851f-02ab1abad4a8 already deleted. [ 1937.260453] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fab0830f-bae0-4a7a-851f-02ab1abad4a8" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1941.279264] env[69188]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1941.279264] env[69188]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1941.504362] env[69188]: INFO networking_nsxv3.common.synchronization [req-b7a85ff3-b6ed-46ca-87eb-8534d1cd0ba5 req-9502f378-0259-4e8a-8eee-1a1bd8ba702d tempest-AttachVolumeNegativeTest-710486423 tempest-AttachVolumeNegativeTest-710486423-project-member] Enqueued Resource ID: fab0830f-bae0-4a7a-851f-02ab1abad4a8 with Priority: HIGHEST for action security_group_members [ 1941.504362] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fab0830f-bae0-4a7a-851f-02ab1abad4a8 with Priority: HIGHEST for action security_group_members [ 1941.504362] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-fab0830f-bae0-4a7a-851f-02ab1abad4a8 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1941.504362] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fab0830f-bae0-4a7a-851f-02ab1abad4a8" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1941.504362] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fab0830f-bae0-4a7a-851f-02ab1abad4a8" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1941.504362] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fab0830f-bae0-4a7a-851f-02ab1abad4a8" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1941.504558] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1941.504558] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1941.504558] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1941.504849] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1941.504849] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1941.504926] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fab0830f-bae0-4a7a-851f-02ab1abad4a8',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1941.742475] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock network-655 taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1941.742675] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "network-655" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1941.742807] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "network-655" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1941.743109] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "network-655" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1941.743370] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1941.743534] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1941.743661] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1941.743884] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1941.744057] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1941.744274] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1941.744395] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] NeedRegenerationException {{(pid=69188) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1941.744509] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] no value, waiting for create lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1941.744621] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] value creation lock acquired {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1941.744736] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1941.744850] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Calling creation function for not-yet-present value {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1941.744985] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1941.763879] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1941.764051] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69188) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1941.764198] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Released creation lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1941.764373] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "network-655" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1941.764666] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock port-62fcebaf-5d7e-444f-b68a-46c6e05e0af2 taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1941.764837] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "port-62fcebaf-5d7e-444f-b68a-46c6e05e0af2" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1941.764965] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "port-62fcebaf-5d7e-444f-b68a-46c6e05e0af2" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1941.765280] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "port-62fcebaf-5d7e-444f-b68a-46c6e05e0af2" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1941.765427] env[69188]: DEBUG networking_nsxv3.api.rpc [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('62fcebaf-5d7e-444f-b68a-46c6e05e0af2',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1942.006596] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1942.006775] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1942.006821] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1942.007020] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1942.007125] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1942.007326] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1942.007424] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1942.007488] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1942.007639] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1942.007733] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1942.007828] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fab0830f-bae0-4a7a-851f-02ab1abad4a8 already deleted. [ 1942.007910] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fab0830f-bae0-4a7a-851f-02ab1abad4a8" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1942.268219] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1942.268492] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1942.268535] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1942.269065] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1942.269065] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1942.269202] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Segment Port 62fcebaf-5d7e-444f-b68a-46c6e05e0af2 not found, creating... [ 1942.269469] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1942.269645] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1942.269774] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1942.270017] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1942.270172] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1942.270455] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1942.270615] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1942.270739] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1942.270947] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1942.271123] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1942.271272] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Resource: SegmentPort with ID: 62fcebaf-5d7e-444f-b68a-46c6e05e0af2 is going to be created. [ 1942.289622] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1942.289967] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1942.289967] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1942.290163] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1942.290389] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1942.290621] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "port-62fcebaf-5d7e-444f-b68a-46c6e05e0af2" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1942.954022] env[69188]: INFO networking_nsxv3.common.synchronization [req-b7a85ff3-b6ed-46ca-87eb-8534d1cd0ba5 req-3e7d7272-8c53-4d11-956b-07147ccf909e service nova] Enqueued Resource ID: fab0830f-bae0-4a7a-851f-02ab1abad4a8 with Priority: HIGHEST for action security_group_rules [ 1942.954022] env[69188]: INFO networking_nsxv3.common.synchronization [req-b7a85ff3-b6ed-46ca-87eb-8534d1cd0ba5 req-3e7d7272-8c53-4d11-956b-07147ccf909e service nova] Enqueued Resource ID: fab0830f-bae0-4a7a-851f-02ab1abad4a8 with Priority: HIGHEST for action security_group_members [ 1942.954022] env[69188]: INFO networking_nsxv3.common.synchronization [req-b7a85ff3-b6ed-46ca-87eb-8534d1cd0ba5 req-3e7d7272-8c53-4d11-956b-07147ccf909e service nova] Enqueued Resource ID: 62fcebaf-5d7e-444f-b68a-46c6e05e0af2 with Priority: HIGHEST for action port [ 1942.954022] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fab0830f-bae0-4a7a-851f-02ab1abad4a8 with Priority: HIGHEST for action security_group_rules [ 1942.954022] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fab0830f-bae0-4a7a-851f-02ab1abad4a8 with Priority: HIGHEST for action security_group_members [ 1942.954022] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 62fcebaf-5d7e-444f-b68a-46c6e05e0af2 with Priority: HIGHEST for action port [ 1942.954022] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fab0830f-bae0-4a7a-851f-02ab1abad4a8 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1942.954022] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fab0830f-bae0-4a7a-851f-02ab1abad4a8" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1942.954022] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fab0830f-bae0-4a7a-851f-02ab1abad4a8" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1942.954665] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fab0830f-bae0-4a7a-851f-02ab1abad4a8" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1942.954837] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fab0830f-bae0-4a7a-851f-02ab1abad4a8',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1942.955933] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-fab0830f-bae0-4a7a-851f-02ab1abad4a8 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1942.956158] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fab0830f-bae0-4a7a-851f-02ab1abad4a8" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1942.956323] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fab0830f-bae0-4a7a-851f-02ab1abad4a8" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1942.956575] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fab0830f-bae0-4a7a-851f-02ab1abad4a8" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1942.956837] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1942.957120] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1942.957273] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1942.957500] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1942.958994] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1942.958994] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fab0830f-bae0-4a7a-851f-02ab1abad4a8',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1942.960714] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-62fcebaf-5d7e-444f-b68a-46c6e05e0af2 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1942.961192] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-62fcebaf-5d7e-444f-b68a-46c6e05e0af2" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1942.961351] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-62fcebaf-5d7e-444f-b68a-46c6e05e0af2" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1942.961638] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-62fcebaf-5d7e-444f-b68a-46c6e05e0af2" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1942.962301] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('62fcebaf-5d7e-444f-b68a-46c6e05e0af2',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1943.463285] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-fab0830f-bae0-4a7a-851f-02ab1abad4a8 taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1943.463623] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fab0830f-bae0-4a7a-851f-02ab1abad4a8" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1943.463623] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fab0830f-bae0-4a7a-851f-02ab1abad4a8',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1943.464525] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 62fcebaf-5d7e-444f-b68a-46c6e05e0af2 with status ACTIVE [ 1943.464699] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1943.464813] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1943.464882] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1943.465103] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1943.465190] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1943.465361] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1943.465458] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1943.465519] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1943.465691] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1943.465747] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1943.465926] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1943.466033] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1943.466095] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1943.466234] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1943.466309] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1943.466392] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 62fcebaf-5d7e-444f-b68a-46c6e05e0af2 is going to be updated. [ 1943.487026] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1943.487174] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1943.487217] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1943.487381] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1943.487499] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1943.487643] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-62fcebaf-5d7e-444f-b68a-46c6e05e0af2" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1943.968292] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fab0830f-bae0-4a7a-851f-02ab1abad4a8',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1944.471473] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1944.471904] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1944.471904] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1944.471904] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1944.472030] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1944.472104] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fab0830f-bae0-4a7a-851f-02ab1abad4a8 is going to be created. [ 1944.494728] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1944.494899] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1944.494941] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1944.495125] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1944.495279] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1944.506418] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fab0830f-bae0-4a7a-851f-02ab1abad4a8 in Status: UNINITIALIZED for 2s [ 1946.518109] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fab0830f-bae0-4a7a-851f-02ab1abad4a8 in Status: SUCCESS [ 1946.518109] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fab0830f-bae0-4a7a-851f-02ab1abad4a8" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1946.518109] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fab0830f-bae0-4a7a-851f-02ab1abad4a8" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1946.518496] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fab0830f-bae0-4a7a-851f-02ab1abad4a8" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1946.518496] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1946.518582] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1946.518693] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1946.518840] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1946.518923] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1946.519017] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fab0830f-bae0-4a7a-851f-02ab1abad4a8" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1946.519110] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fab0830f-bae0-4a7a-851f-02ab1abad4a8',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1947.021220] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fab0830f-bae0-4a7a-851f-02ab1abad4a8',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1947.523799] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fab0830f-bae0-4a7a-851f-02ab1abad4a8: rpc.has_security_group_logging(os_id): False [ 1947.540775] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1947.540960] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1947.540960] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1947.541167] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1947.541257] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1947.541483] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1947.541584] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1947.541649] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1947.541805] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1947.541892] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1947.541979] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fab0830f-bae0-4a7a-851f-02ab1abad4a8 is going to be created. [ 1947.598970] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1947.599099] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1947.599181] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1947.599324] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1947.599491] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1947.608534] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fab0830f-bae0-4a7a-851f-02ab1abad4a8 in Status: IN_PROGRESS for 2s [ 1947.954690] env[69188]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1947.954874] env[69188]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1949.621118] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fab0830f-bae0-4a7a-851f-02ab1abad4a8 in Status: SUCCESS [ 1949.621482] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fab0830f-bae0-4a7a-851f-02ab1abad4a8" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1952.955961] env[69188]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1952.956319] env[69188]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1957.957539] env[69188]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1957.957873] env[69188]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1962.958738] env[69188]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1962.959114] env[69188]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1967.959947] env[69188]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1967.960340] env[69188]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1972.960850] env[69188]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1972.961218] env[69188]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1977.961391] env[69188]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1977.961709] env[69188]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1982.962056] env[69188]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1982.962420] env[69188]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1987.962960] env[69188]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1987.963379] env[69188]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1989.545011] env[69188]: INFO networking_nsxv3.common.synchronization [req-b766764e-4410-4ca4-9f87-6d5d7d06bba3 req-c6557ee1-25bc-4da7-a5d8-b8c939f43609 tempest-AttachVolumeNegativeTest-710486423 tempest-AttachVolumeNegativeTest-710486423-project-member] Enqueued Resource ID: fab0830f-bae0-4a7a-851f-02ab1abad4a8 with Priority: HIGHEST for action security_group_members [ 1989.545547] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fab0830f-bae0-4a7a-851f-02ab1abad4a8 with Priority: HIGHEST for action security_group_members [ 1989.545946] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-fab0830f-bae0-4a7a-851f-02ab1abad4a8 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1989.545946] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fab0830f-bae0-4a7a-851f-02ab1abad4a8" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1989.546093] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fab0830f-bae0-4a7a-851f-02ab1abad4a8" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1989.546249] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fab0830f-bae0-4a7a-851f-02ab1abad4a8" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1989.546362] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1989.546458] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1989.546511] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1989.546652] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1989.546738] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1989.546828] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fab0830f-bae0-4a7a-851f-02ab1abad4a8',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1990.049486] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1990.049712] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1990.049712] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1990.049917] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1990.050023] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1990.050243] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1990.050349] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1990.050414] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1990.050574] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1990.050657] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1990.050747] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fab0830f-bae0-4a7a-851f-02ab1abad4a8 is going to be updated. [ 1990.078052] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1990.078183] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1990.078219] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1990.078362] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1990.078494] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1990.085684] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fab0830f-bae0-4a7a-851f-02ab1abad4a8 in Status: IN_PROGRESS for 2s [ 1992.096239] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fab0830f-bae0-4a7a-851f-02ab1abad4a8 in Status: SUCCESS [ 1992.096608] env[69188]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fab0830f-bae0-4a7a-851f-02ab1abad4a8 deletion is rescheduled due to dependency. [ 1992.096608] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fab0830f-bae0-4a7a-851f-02ab1abad4a8" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1994.546718] env[69188]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1994.547177] env[69188]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1999.548167] env[69188]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1999.548534] env[69188]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2000.215595] env[69188]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-ca0141f8-e0d0-45bb-94d3-6579b85b932c None None] NSXv3 Agent Agent loop - iteration:5 completed [ 2000.215809] env[69188]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-ca0141f8-e0d0-45bb-94d3-6579b85b932c None None] NSXv3 Agent Agent loop - iteration:6 started [ 2001.014494] env[69188]: INFO networking_nsxv3.common.synchronization [req-de11de8c-92dd-4d4f-ae81-44459e8aa300 req-66cafa7d-cd83-4327-bc75-598133d3c910 tempest-AttachVolumeNegativeTest-710486423 tempest-AttachVolumeNegativeTest-710486423-project-member] Enqueued Resource ID: 61518cd2-637a-4fec-b890-2b6ae31ab7eb with Priority: HIGHEST for action security_group_members [ 2001.014998] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 61518cd2-637a-4fec-b890-2b6ae31ab7eb with Priority: HIGHEST for action security_group_members [ 2001.015320] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-61518cd2-637a-4fec-b890-2b6ae31ab7eb taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2001.015444] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-61518cd2-637a-4fec-b890-2b6ae31ab7eb" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2001.015513] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-61518cd2-637a-4fec-b890-2b6ae31ab7eb" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2001.015711] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-61518cd2-637a-4fec-b890-2b6ae31ab7eb" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2001.015859] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2001.015962] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2001.016059] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2001.016189] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2001.016271] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2001.016363] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('61518cd2-637a-4fec-b890-2b6ae31ab7eb',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2001.518944] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2001.519192] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2001.519192] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2001.519376] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2001.519477] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2001.519677] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2001.519776] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2001.519840] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2001.519990] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2001.520082] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2001.520189] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 61518cd2-637a-4fec-b890-2b6ae31ab7eb is going to be updated. [ 2001.547983] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2001.548122] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2001.548198] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2001.548333] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2001.548463] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2001.555463] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 61518cd2-637a-4fec-b890-2b6ae31ab7eb in Status: IN_PROGRESS for 2s [ 2003.566867] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 61518cd2-637a-4fec-b890-2b6ae31ab7eb in Status: SUCCESS [ 2003.567253] env[69188]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 61518cd2-637a-4fec-b890-2b6ae31ab7eb deletion is rescheduled due to dependency. [ 2003.567253] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-61518cd2-637a-4fec-b890-2b6ae31ab7eb" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2005.610941] env[69188]: INFO networking_nsxv3.common.synchronization [None req-e913711d-d4f0-49ff-8779-a02f9e17cab6 tempest-AttachVolumeNegativeTest-710486423 tempest-AttachVolumeNegativeTest-710486423-project-member] Enqueued Resource ID: 49823780-57da-4d86-9e4f-035c5e58881c with Priority: HIGHEST for action security_group_rules [ 2005.611484] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 49823780-57da-4d86-9e4f-035c5e58881c with Priority: HIGHEST for action security_group_rules [ 2005.611793] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-49823780-57da-4d86-9e4f-035c5e58881c taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2005.611915] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-49823780-57da-4d86-9e4f-035c5e58881c" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2005.611984] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-49823780-57da-4d86-9e4f-035c5e58881c" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2005.612244] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-49823780-57da-4d86-9e4f-035c5e58881c" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2005.612329] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('49823780-57da-4d86-9e4f-035c5e58881c',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2005.708883] env[69188]: INFO networking_nsxv3.common.synchronization [None req-42e29312-d5fd-4c3e-a27e-2d5c4139beb2 tempest-AttachVolumeNegativeTest-710486423 tempest-AttachVolumeNegativeTest-710486423-project-member] Enqueued Resource ID: 49823780-57da-4d86-9e4f-035c5e58881c with Priority: HIGHEST for action security_group_rules [ 2005.708883] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 49823780-57da-4d86-9e4f-035c5e58881c with Priority: HIGHEST for action security_group_rules [ 2005.709186] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-49823780-57da-4d86-9e4f-035c5e58881c taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2005.709317] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-49823780-57da-4d86-9e4f-035c5e58881c" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2006.133053] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2006.133206] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2006.133206] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2006.133478] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2006.133600] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2006.133726] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 49823780-57da-4d86-9e4f-035c5e58881c already deleted. [ 2006.133836] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-49823780-57da-4d86-9e4f-035c5e58881c" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2006.134009] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-49823780-57da-4d86-9e4f-035c5e58881c" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2006.134222] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-49823780-57da-4d86-9e4f-035c5e58881c" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2006.134333] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('49823780-57da-4d86-9e4f-035c5e58881c',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2006.653760] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2006.653760] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2006.653760] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2006.654379] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2006.654379] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2006.654379] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 49823780-57da-4d86-9e4f-035c5e58881c already deleted. [ 2006.654379] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-49823780-57da-4d86-9e4f-035c5e58881c" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2010.710071] env[69188]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2010.710384] env[69188]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2010.850387] env[69188]: INFO networking_nsxv3.common.synchronization [req-2240d75b-f097-4a20-b895-04dc105afdfe req-059f7106-080c-4360-b43b-6eb9e2f93869 tempest-AttachVolumeNegativeTest-710486423 tempest-AttachVolumeNegativeTest-710486423-project-member] Enqueued Resource ID: 49823780-57da-4d86-9e4f-035c5e58881c with Priority: HIGHEST for action security_group_members [ 2010.850880] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 49823780-57da-4d86-9e4f-035c5e58881c with Priority: HIGHEST for action security_group_members [ 2010.851892] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-49823780-57da-4d86-9e4f-035c5e58881c taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2010.851892] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-49823780-57da-4d86-9e4f-035c5e58881c" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2010.851892] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-49823780-57da-4d86-9e4f-035c5e58881c" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2010.851892] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-49823780-57da-4d86-9e4f-035c5e58881c" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2010.851892] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2010.851892] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2010.852301] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2010.852301] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2010.852301] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2010.852301] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('49823780-57da-4d86-9e4f-035c5e58881c',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2011.075133] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock network-655 taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2011.075287] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "network-655" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2011.075416] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "network-655" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2011.075691] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "network-655" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2011.075951] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2011.076128] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2011.076252] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2011.076468] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2011.076688] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2011.076971] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 2011.077114] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] NeedRegenerationException {{(pid=69188) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 2011.077269] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] no value, waiting for create lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 2011.077396] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] value creation lock acquired {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 2011.077518] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 2011.077630] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Calling creation function for not-yet-present value {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 2011.077768] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 2011.098941] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 2011.099197] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69188) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 2011.099463] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Released creation lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 2011.099640] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "network-655" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2011.100045] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock port-81559e6c-4022-4756-8055-77177a42d0bb taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2011.100300] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "port-81559e6c-4022-4756-8055-77177a42d0bb" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2011.100467] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "port-81559e6c-4022-4756-8055-77177a42d0bb" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2011.100816] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "port-81559e6c-4022-4756-8055-77177a42d0bb" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2011.101038] env[69188]: DEBUG networking_nsxv3.api.rpc [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('81559e6c-4022-4756-8055-77177a42d0bb',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2011.354374] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2011.354577] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2011.354577] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2011.354798] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2011.354888] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2011.355102] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2011.355214] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2011.355263] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2011.355409] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2011.355481] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2011.355570] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 49823780-57da-4d86-9e4f-035c5e58881c already deleted. [ 2011.355648] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-49823780-57da-4d86-9e4f-035c5e58881c" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2011.607593] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2011.607925] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2011.608183] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2011.608549] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2011.608819] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2011.609104] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Segment Port 81559e6c-4022-4756-8055-77177a42d0bb not found, creating... [ 2011.609548] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2011.609772] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2011.610033] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2011.610332] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2011.610486] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2011.610774] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2011.610958] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2011.611546] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2011.611546] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2011.611546] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2011.611752] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Resource: SegmentPort with ID: 81559e6c-4022-4756-8055-77177a42d0bb is going to be created. [ 2011.631713] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2011.631906] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2011.632056] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2011.632306] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2011.632529] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2011.632738] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "port-81559e6c-4022-4756-8055-77177a42d0bb" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2012.283840] env[69188]: INFO networking_nsxv3.common.synchronization [req-2240d75b-f097-4a20-b895-04dc105afdfe req-7cf11cd1-2b01-4a0e-a906-f4a4cc33e3fd service nova] Enqueued Resource ID: 49823780-57da-4d86-9e4f-035c5e58881c with Priority: HIGHEST for action security_group_rules [ 2012.284088] env[69188]: INFO networking_nsxv3.common.synchronization [req-2240d75b-f097-4a20-b895-04dc105afdfe req-7cf11cd1-2b01-4a0e-a906-f4a4cc33e3fd service nova] Enqueued Resource ID: 49823780-57da-4d86-9e4f-035c5e58881c with Priority: HIGHEST for action security_group_members [ 2012.284204] env[69188]: INFO networking_nsxv3.common.synchronization [req-2240d75b-f097-4a20-b895-04dc105afdfe req-7cf11cd1-2b01-4a0e-a906-f4a4cc33e3fd service nova] Enqueued Resource ID: 81559e6c-4022-4756-8055-77177a42d0bb with Priority: HIGHEST for action port [ 2012.284398] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 49823780-57da-4d86-9e4f-035c5e58881c with Priority: HIGHEST for action security_group_rules [ 2012.284529] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 49823780-57da-4d86-9e4f-035c5e58881c with Priority: HIGHEST for action security_group_members [ 2012.284623] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 81559e6c-4022-4756-8055-77177a42d0bb with Priority: HIGHEST for action port [ 2012.285154] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-49823780-57da-4d86-9e4f-035c5e58881c taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2012.285282] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-49823780-57da-4d86-9e4f-035c5e58881c" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2012.285347] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-49823780-57da-4d86-9e4f-035c5e58881c" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2012.285537] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-49823780-57da-4d86-9e4f-035c5e58881c" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2012.285617] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('49823780-57da-4d86-9e4f-035c5e58881c',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2012.286480] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-49823780-57da-4d86-9e4f-035c5e58881c taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2012.286592] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-49823780-57da-4d86-9e4f-035c5e58881c" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2012.286653] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-49823780-57da-4d86-9e4f-035c5e58881c" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2012.286812] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-49823780-57da-4d86-9e4f-035c5e58881c" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2012.286956] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2012.287063] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2012.287127] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2012.287266] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2012.287350] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2012.287435] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('49823780-57da-4d86-9e4f-035c5e58881c',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2012.288142] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-81559e6c-4022-4756-8055-77177a42d0bb taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2012.288242] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-81559e6c-4022-4756-8055-77177a42d0bb" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2012.288308] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-81559e6c-4022-4756-8055-77177a42d0bb" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2012.288456] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-81559e6c-4022-4756-8055-77177a42d0bb" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2012.288530] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('81559e6c-4022-4756-8055-77177a42d0bb',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2012.790789] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-49823780-57da-4d86-9e4f-035c5e58881c taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2012.790922] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-49823780-57da-4d86-9e4f-035c5e58881c" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2012.791125] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('49823780-57da-4d86-9e4f-035c5e58881c',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2012.792372] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 81559e6c-4022-4756-8055-77177a42d0bb with status ACTIVE [ 2012.792558] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2012.792671] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2012.792743] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2012.792946] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2012.793040] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2012.793227] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2012.793311] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2012.793367] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2012.793516] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2012.793596] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2012.793776] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2012.793868] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2012.793925] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2012.794241] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2012.794322] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2012.794412] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 81559e6c-4022-4756-8055-77177a42d0bb is going to be updated. [ 2012.816478] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2012.816651] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2012.816651] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2012.816840] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2012.816969] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2012.817134] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-81559e6c-4022-4756-8055-77177a42d0bb" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2013.296986] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('49823780-57da-4d86-9e4f-035c5e58881c',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2013.799745] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2013.800048] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2013.800048] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2013.800211] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2013.800323] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2013.800432] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 49823780-57da-4d86-9e4f-035c5e58881c is going to be created. [ 2013.822195] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2013.822321] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2013.822392] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2013.822545] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2013.822694] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2013.831264] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 49823780-57da-4d86-9e4f-035c5e58881c in Status: UNINITIALIZED for 2s [ 2015.842046] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 49823780-57da-4d86-9e4f-035c5e58881c in Status: SUCCESS [ 2015.842419] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-49823780-57da-4d86-9e4f-035c5e58881c" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2015.842419] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-49823780-57da-4d86-9e4f-035c5e58881c" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2015.842536] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-49823780-57da-4d86-9e4f-035c5e58881c" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2015.842699] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2015.842814] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2015.842879] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2015.843037] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2015.843119] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2015.843205] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-49823780-57da-4d86-9e4f-035c5e58881c" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2015.843295] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('49823780-57da-4d86-9e4f-035c5e58881c',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2016.345614] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('49823780-57da-4d86-9e4f-035c5e58881c',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2016.848692] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 49823780-57da-4d86-9e4f-035c5e58881c: rpc.has_security_group_logging(os_id): False [ 2016.865861] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2016.866026] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2016.866065] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2016.866316] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2016.866411] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2016.866649] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2016.866755] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2016.866812] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2016.866967] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2016.867061] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2016.867153] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 49823780-57da-4d86-9e4f-035c5e58881c is going to be created. [ 2016.922804] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2016.922921] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2016.922990] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2016.923180] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2016.923354] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2016.931964] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 49823780-57da-4d86-9e4f-035c5e58881c in Status: IN_PROGRESS for 2s [ 2017.285914] env[69188]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2017.286080] env[69188]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 2018.945141] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 49823780-57da-4d86-9e4f-035c5e58881c in Status: SUCCESS [ 2018.945487] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-49823780-57da-4d86-9e4f-035c5e58881c" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2022.287191] env[69188]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2022.287642] env[69188]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2024.165393] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2024.165787] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2024.165787] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2024.165863] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2024.166024] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2024.667943] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2025.170584] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2025.673330] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 2025.673537] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 2026.492522] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2026.492934] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2026.492934] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2026.492934] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2026.505444] env[69188]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 2026.506253] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2026.506947] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 2026.545484] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2026.545622] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2026.545672] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2026.545850] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2026.558568] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2026.559243] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 2026.559319] env[69188]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=69188) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 2026.559426] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 2026.578254] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2026.578356] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2026.578399] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2026.578553] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2026.578833] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2026.578958] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 2026.652366] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2026.652567] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2026.652567] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2026.652747] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2026.653048] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2026.653301] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 2026.723147] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2026.723289] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2026.723344] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2026.723515] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2026.723775] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2026.724019] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:4. [ 2026.724102] env[69188]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'49823780-57da-4d86-9e4f-035c5e58881c', 'fab0830f-bae0-4a7a-851f-02ab1abad4a8', '57c5faf9-ee2e-4964-943f-bc73f230e7dc', '61518cd2-637a-4fec-b890-2b6ae31ab7eb'} {{(pid=69188) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 2026.724195] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 2026.740721] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2026.740848] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2026.740890] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2026.741077] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2026.741159] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2026.741258] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 2026.741330] env[69188]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=69188) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 2026.741400] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 2026.817056] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2026.817258] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2026.817258] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2026.817498] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2026.818561] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2026.818797] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 2026.818878] env[69188]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=69188) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 2026.818949] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 2026.819027] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 2026.819106] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 4/4 resources of Type:Security Group Rules [ 2026.819179] env[69188]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 49823780-57da-4d86-9e4f-035c5e58881c with Priority: HIGH for action security_group_rules [ 2026.819257] env[69188]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: fab0830f-bae0-4a7a-851f-02ab1abad4a8 with Priority: HIGH for action security_group_rules [ 2026.819325] env[69188]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 57c5faf9-ee2e-4964-943f-bc73f230e7dc with Priority: HIGH for action security_group_rules [ 2026.819421] env[69188]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 61518cd2-637a-4fec-b890-2b6ae31ab7eb with Priority: HIGH for action security_group_rules [ 2026.819494] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Members [ 2026.819560] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:QoS [ 2026.819744] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , >, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2026.819841] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2026.819897] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2026.820060] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2026.820138] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2026.820314] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2026.820406] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2026.820464] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2026.820597] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2026.820671] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2026.820837] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2026.820925] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2026.820985] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2026.821132] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2026.821205] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2026.821368] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2026.821455] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2026.821516] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2026.821649] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2026.821720] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2026.821883] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2026.821972] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2026.822042] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2026.822176] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2026.822247] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2026.822446] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2026.822507] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2026.822559] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2026.822674] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2026.822745] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2026.822906] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2026.822994] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2026.823066] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2026.823198] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2026.823268] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2026.823430] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2026.823517] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2026.823574] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2026.823703] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2026.823773] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2026.823933] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2026.824030] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2026.824089] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2026.824218] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2026.824288] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2026.824448] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2026.824536] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2026.824594] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2026.824724] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2026.824794] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2026.824953] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2026.825049] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2026.825104] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2026.825233] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2026.825302] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2026.825469] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2026.825562] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2026.825606] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2026.825727] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2026.825800] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2026.825957] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2026.826055] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2026.826114] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2026.826244] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2026.826316] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2026.826476] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2026.826567] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2026.826625] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2026.826753] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2026.826823] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2026.826983] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2026.827082] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2026.827140] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2026.827274] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2026.827355] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2026.827548] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2026.827641] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2026.827701] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2026.827837] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2026.827906] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2026.828082] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2026.828171] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2026.828229] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2026.828359] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2026.828429] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2026.828589] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2026.828677] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2026.828734] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2026.828861] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2026.828931] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2026.829103] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2026.829189] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2026.829248] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2026.829382] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2026.829469] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2026.829634] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2026.829721] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2026.829779] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2026.829910] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2026.829978] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2026.830154] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2026.830242] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2026.830300] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2026.830430] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2026.830501] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2026.830660] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2026.830747] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2026.830805] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2026.830934] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2026.831012] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2026.831180] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2026.831266] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2026.831322] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2026.831450] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2026.831522] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2026.831681] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2026.831767] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2026.831824] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2026.831953] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2026.832033] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2026.832195] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2026.832281] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2026.832335] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2026.832465] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2026.832564] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2026.832691] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2026.832778] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2026.832836] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2026.832966] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2026.833048] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2026.833209] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2026.833296] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2026.833350] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2026.833480] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2026.833550] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2026.833712] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2026.833798] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2026.833855] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2026.833983] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2026.834066] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2026.834227] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2026.834313] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2026.834371] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2026.834560] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2026.834661] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2026.834897] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2026.835032] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2026.835119] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2026.835299] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2026.835399] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2026.835637] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2026.835761] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2026.835848] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2026.836043] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2026.836147] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2026.836381] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2026.836505] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2026.836591] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2026.836768] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2026.836869] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2026.837117] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2026.837241] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2026.837331] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2026.837514] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2026.837617] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2026.837852] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2026.837975] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2026.838075] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2026.838257] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2026.838358] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2026.838591] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2026.838717] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2026.838804] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2026.838981] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2026.839094] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2026.839329] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2026.839459] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2026.839548] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2026.839727] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2026.839827] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2026.840074] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2026.840200] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2026.840288] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2026.840465] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2026.840567] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2026.840801] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2026.840923] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2026.841020] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2026.841203] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2026.841301] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2026.841535] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2026.841659] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2026.841745] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2026.841923] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2026.842034] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2026.842270] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2026.842395] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2026.842482] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2026.842672] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2026.842719] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2026.842888] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2026.842982] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2026.843056] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2026.843192] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2026.843265] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2026.843428] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2026.843517] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2026.843577] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2026.843708] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2026.843778] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2026.843939] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2026.844037] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2026.844096] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2026.844226] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2026.844296] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2026.844457] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2026.844545] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2026.844603] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2026.844732] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2026.844802] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2026.844961] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2026.845061] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2026.845118] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2026.845248] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2026.845318] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2026.845478] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2026.845565] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2026.845618] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2026.845743] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2026.845812] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2026.845971] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2026.846068] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2026.846126] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2026.846255] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2026.846325] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2026.846484] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2026.846570] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2026.846628] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2026.846757] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2026.846826] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2026.846984] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2026.847082] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2026.847140] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2026.847271] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2026.847340] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2026.847522] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2026.847613] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2026.847671] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2026.847803] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2026.847875] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2026.848047] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2026.848138] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2026.848195] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2026.848325] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2026.848396] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2026.848556] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2026.848641] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2026.848698] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2026.848825] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2026.848895] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2026.849069] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2026.849155] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2026.849214] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2026.849345] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2026.849438] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2026.849618] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2026.849709] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2026.849766] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2026.849898] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2026.849967] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2026.850141] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2026.850242] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2026.850295] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2026.850408] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2026.850477] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2026.850636] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2026.850722] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2026.850780] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2026.850907] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2026.850976] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2026.851150] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2026.851237] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2026.851294] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2026.851422] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2026.851491] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2026.851649] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2026.851735] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2026.851792] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2026.851920] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2026.851989] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2026.852163] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2026.852248] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2026.852305] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2026.852432] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2026.852503] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2026.852662] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2026.852782] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2026.852837] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2026.852924] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2026.852992] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2026.853165] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2026.853251] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2026.853307] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2026.853435] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2026.853504] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2026.853663] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2026.853748] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2026.853805] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2026.853932] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2026.854006] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2026.854172] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2026.854259] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2026.854312] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2026.854441] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2026.854510] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2026.854669] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2026.854755] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2026.854813] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2026.854941] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2026.855019] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2026.855178] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2026.855266] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2026.855319] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2026.855448] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2026.855517] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2026.855690] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2026.855776] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2026.855833] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2026.855962] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2026.856043] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2026.856204] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2026.856290] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2026.856344] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2026.856475] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2026.856546] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2026.856705] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2026.856789] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2026.856846] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2026.856973] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2026.857053] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2026.857214] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2026.857300] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2026.857355] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2026.857505] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2026.857578] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2026.857740] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2026.857827] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2026.857884] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2026.858022] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2026.858095] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2026.858203] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Items outdated since last Agent sanitize:65 [ 2026.858269] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Refreshing 16 of least updated resources [ 2026.858341] env[69188]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 948c6e1f-1c67-4d7c-bf02-0ca6a7c3cbda with Priority: HIGH for action security_group_members [ 2026.858419] env[69188]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 8960cdd5-264d-45ae-a581-3531272dfbaa with Priority: HIGH for action security_group_members [ 2026.858487] env[69188]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f85bb0c6-bf80-4499-b5c3-0b4c4169bdc0 with Priority: HIGH for action security_group_members [ 2026.858553] env[69188]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d7156740-676b-417b-9850-f10d741c20bd with Priority: HIGH for action security_group_members [ 2026.858616] env[69188]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: eb8c8265-ddd7-41a1-a435-066f89c523e5 with Priority: HIGH for action security_group_members [ 2026.858680] env[69188]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 2a389e0c-0be3-41c9-986c-f4b06040a24d with Priority: HIGH for action security_group_members [ 2026.858744] env[69188]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c7e4a274-48d0-4c86-9db6-5b72611db3e7 with Priority: HIGH for action security_group_members [ 2026.858807] env[69188]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: fa6e8a6e-b63b-4248-b67b-4ae889fac90c with Priority: HIGH for action security_group_members [ 2026.858871] env[69188]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 22266528-0231-4142-81c2-081f9d6cd11d with Priority: HIGH for action security_group_members [ 2026.858934] env[69188]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 2c6aa97b-8577-4c5e-8b88-1678798f98a7 with Priority: HIGH for action security_group_members [ 2026.858998] env[69188]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 397559b2-3c5a-424d-b09d-43a25d2abba6 with Priority: HIGH for action security_group_members [ 2026.859075] env[69188]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9f2518e8-b195-4520-b262-caa765ab7e27 with Priority: HIGH for action security_group_members [ 2026.859139] env[69188]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 166e7c17-8917-425e-9cd8-0580f8aa3e74 with Priority: HIGH for action security_group_members [ 2026.859203] env[69188]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e1f5743d-088c-4b6d-9680-d1a339199c95 with Priority: HIGH for action security_group_members [ 2026.859267] env[69188]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 2240419a-b1eb-469c-b2f2-8c54a91fa4b9 with Priority: HIGH for action security_group_members [ 2026.859331] env[69188]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 12570d95-0a4a-4579-82c8-53ecf65f714e with Priority: HIGH for action security_group_members [ 2026.859444] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2027.288020] env[69188]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2027.288187] env[69188]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=20], Jobs=0 [ 2027.288272] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 49823780-57da-4d86-9e4f-035c5e58881c with Priority: HIGH for action security_group_rules [ 2027.288366] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57c5faf9-ee2e-4964-943f-bc73f230e7dc with Priority: HIGH for action security_group_rules [ 2027.288461] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f85bb0c6-bf80-4499-b5c3-0b4c4169bdc0 with Priority: HIGH for action security_group_members [ 2027.288555] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 397559b2-3c5a-424d-b09d-43a25d2abba6 with Priority: HIGH for action security_group_members [ 2027.288645] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 12570d95-0a4a-4579-82c8-53ecf65f714e with Priority: HIGH for action security_group_members [ 2027.288731] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2240419a-b1eb-469c-b2f2-8c54a91fa4b9 with Priority: HIGH for action security_group_members [ 2027.288816] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e1f5743d-088c-4b6d-9680-d1a339199c95 with Priority: HIGH for action security_group_members [ 2027.288902] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 166e7c17-8917-425e-9cd8-0580f8aa3e74 with Priority: HIGH for action security_group_members [ 2027.288988] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c6aa97b-8577-4c5e-8b88-1678798f98a7 with Priority: HIGH for action security_group_members [ 2027.289092] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f2518e8-b195-4520-b262-caa765ab7e27 with Priority: HIGH for action security_group_members [ 2027.289180] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 22266528-0231-4142-81c2-081f9d6cd11d with Priority: HIGH for action security_group_members [ 2027.289267] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fa6e8a6e-b63b-4248-b67b-4ae889fac90c with Priority: HIGH for action security_group_members [ 2027.289353] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c7e4a274-48d0-4c86-9db6-5b72611db3e7 with Priority: HIGH for action security_group_members [ 2027.289487] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2a389e0c-0be3-41c9-986c-f4b06040a24d with Priority: HIGH for action security_group_members [ 2027.289577] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eb8c8265-ddd7-41a1-a435-066f89c523e5 with Priority: HIGH for action security_group_members [ 2027.289666] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8960cdd5-264d-45ae-a581-3531272dfbaa with Priority: HIGH for action security_group_members [ 2027.289751] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d7156740-676b-417b-9850-f10d741c20bd with Priority: HIGH for action security_group_members [ 2027.289833] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 948c6e1f-1c67-4d7c-bf02-0ca6a7c3cbda with Priority: HIGH for action security_group_members [ 2027.289914] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fab0830f-bae0-4a7a-851f-02ab1abad4a8 with Priority: HIGH for action security_group_rules [ 2027.290015] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 61518cd2-637a-4fec-b890-2b6ae31ab7eb with Priority: HIGH for action security_group_rules [ 2027.290347] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-49823780-57da-4d86-9e4f-035c5e58881c taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2027.290495] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-49823780-57da-4d86-9e4f-035c5e58881c" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2027.290566] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-49823780-57da-4d86-9e4f-035c5e58881c" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2027.290779] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-49823780-57da-4d86-9e4f-035c5e58881c" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2027.290863] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('49823780-57da-4d86-9e4f-035c5e58881c',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2027.291805] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-57c5faf9-ee2e-4964-943f-bc73f230e7dc taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2027.291925] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-57c5faf9-ee2e-4964-943f-bc73f230e7dc" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2027.291990] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-57c5faf9-ee2e-4964-943f-bc73f230e7dc" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2027.292170] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-57c5faf9-ee2e-4964-943f-bc73f230e7dc" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2027.292246] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('57c5faf9-ee2e-4964-943f-bc73f230e7dc',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2027.293324] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-f85bb0c6-bf80-4499-b5c3-0b4c4169bdc0 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2027.293447] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f85bb0c6-bf80-4499-b5c3-0b4c4169bdc0" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2027.293495] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f85bb0c6-bf80-4499-b5c3-0b4c4169bdc0" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2027.293675] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f85bb0c6-bf80-4499-b5c3-0b4c4169bdc0" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2027.293993] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2027.293993] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2027.293993] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2027.294133] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2027.294186] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2027.294274] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f85bb0c6-bf80-4499-b5c3-0b4c4169bdc0',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2027.294939] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-397559b2-3c5a-424d-b09d-43a25d2abba6 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2027.295057] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-397559b2-3c5a-424d-b09d-43a25d2abba6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2027.295126] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-397559b2-3c5a-424d-b09d-43a25d2abba6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2027.295291] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-397559b2-3c5a-424d-b09d-43a25d2abba6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2027.295432] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2027.295528] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2027.295589] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2027.295723] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2027.295799] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2027.295878] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('397559b2-3c5a-424d-b09d-43a25d2abba6',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2027.296580] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-12570d95-0a4a-4579-82c8-53ecf65f714e taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2027.296700] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-12570d95-0a4a-4579-82c8-53ecf65f714e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2027.296767] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-12570d95-0a4a-4579-82c8-53ecf65f714e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2027.296915] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-12570d95-0a4a-4579-82c8-53ecf65f714e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2027.297072] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2027.297166] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2027.297227] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2027.297361] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2027.297434] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2027.297512] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('12570d95-0a4a-4579-82c8-53ecf65f714e',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2027.298204] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-2240419a-b1eb-469c-b2f2-8c54a91fa4b9 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2027.298482] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2240419a-b1eb-469c-b2f2-8c54a91fa4b9" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2027.298482] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2240419a-b1eb-469c-b2f2-8c54a91fa4b9" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2027.298571] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2240419a-b1eb-469c-b2f2-8c54a91fa4b9" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2027.298636] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2027.298730] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2027.298791] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2027.298954] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2027.299077] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2027.299161] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2240419a-b1eb-469c-b2f2-8c54a91fa4b9',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2027.299863] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-e1f5743d-088c-4b6d-9680-d1a339199c95 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2027.299969] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e1f5743d-088c-4b6d-9680-d1a339199c95" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2027.300047] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e1f5743d-088c-4b6d-9680-d1a339199c95" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2027.300199] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e1f5743d-088c-4b6d-9680-d1a339199c95" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2027.300336] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2027.300547] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2027.300837] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2027.300837] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2027.300837] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2027.300948] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e1f5743d-088c-4b6d-9680-d1a339199c95',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2027.301577] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-166e7c17-8917-425e-9cd8-0580f8aa3e74 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2027.301681] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-166e7c17-8917-425e-9cd8-0580f8aa3e74" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2027.301774] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-166e7c17-8917-425e-9cd8-0580f8aa3e74" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2027.301956] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-166e7c17-8917-425e-9cd8-0580f8aa3e74" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2027.302116] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2027.302212] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2027.302274] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2027.302411] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2027.302487] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2027.302565] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('166e7c17-8917-425e-9cd8-0580f8aa3e74',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2027.303256] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-2c6aa97b-8577-4c5e-8b88-1678798f98a7 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2027.303363] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2c6aa97b-8577-4c5e-8b88-1678798f98a7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2027.303430] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2c6aa97b-8577-4c5e-8b88-1678798f98a7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2027.303569] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2c6aa97b-8577-4c5e-8b88-1678798f98a7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2027.303708] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2027.303801] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2027.303864] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2027.303998] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2027.304085] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2027.304176] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2c6aa97b-8577-4c5e-8b88-1678798f98a7',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2027.304845] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-9f2518e8-b195-4520-b262-caa765ab7e27 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2027.304961] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9f2518e8-b195-4520-b262-caa765ab7e27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2027.305021] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9f2518e8-b195-4520-b262-caa765ab7e27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2027.305171] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9f2518e8-b195-4520-b262-caa765ab7e27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2027.305307] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2027.305400] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2027.305461] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2027.305594] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2027.305668] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2027.305747] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9f2518e8-b195-4520-b262-caa765ab7e27',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2027.306544] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-22266528-0231-4142-81c2-081f9d6cd11d taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2027.306647] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-22266528-0231-4142-81c2-081f9d6cd11d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2027.306718] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-22266528-0231-4142-81c2-081f9d6cd11d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2027.306865] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-22266528-0231-4142-81c2-081f9d6cd11d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2027.307008] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2027.307247] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2027.307247] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2027.307337] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2027.307373] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2027.307488] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('22266528-0231-4142-81c2-081f9d6cd11d',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2027.308119] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-fa6e8a6e-b63b-4248-b67b-4ae889fac90c taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2027.308218] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fa6e8a6e-b63b-4248-b67b-4ae889fac90c" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2027.308285] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fa6e8a6e-b63b-4248-b67b-4ae889fac90c" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2027.308431] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fa6e8a6e-b63b-4248-b67b-4ae889fac90c" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2027.308568] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2027.308660] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2027.308722] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2027.308857] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2027.308929] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2027.309014] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fa6e8a6e-b63b-4248-b67b-4ae889fac90c',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2027.309725] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-c7e4a274-48d0-4c86-9db6-5b72611db3e7 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2027.309842] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c7e4a274-48d0-4c86-9db6-5b72611db3e7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2027.309887] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c7e4a274-48d0-4c86-9db6-5b72611db3e7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2027.310046] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c7e4a274-48d0-4c86-9db6-5b72611db3e7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2027.310186] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2027.310271] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2027.310387] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2027.310559] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2027.310638] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2027.310719] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c7e4a274-48d0-4c86-9db6-5b72611db3e7',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2027.311404] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-2a389e0c-0be3-41c9-986c-f4b06040a24d taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2027.311511] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2a389e0c-0be3-41c9-986c-f4b06040a24d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2027.311578] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2a389e0c-0be3-41c9-986c-f4b06040a24d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2027.311737] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2a389e0c-0be3-41c9-986c-f4b06040a24d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2027.311887] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2027.311983] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2027.312057] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2027.312198] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2027.312272] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2027.312351] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2a389e0c-0be3-41c9-986c-f4b06040a24d',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2027.313158] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-eb8c8265-ddd7-41a1-a435-066f89c523e5 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2027.313223] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eb8c8265-ddd7-41a1-a435-066f89c523e5" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2027.313291] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eb8c8265-ddd7-41a1-a435-066f89c523e5" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2027.313440] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eb8c8265-ddd7-41a1-a435-066f89c523e5" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2027.313576] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2027.313668] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2027.313729] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2027.313905] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2027.314030] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2027.314030] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('eb8c8265-ddd7-41a1-a435-066f89c523e5',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2027.314684] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-8960cdd5-264d-45ae-a581-3531272dfbaa taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2027.314793] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8960cdd5-264d-45ae-a581-3531272dfbaa" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2027.314858] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8960cdd5-264d-45ae-a581-3531272dfbaa" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2027.314996] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8960cdd5-264d-45ae-a581-3531272dfbaa" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2027.315148] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2027.315238] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2027.315295] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2027.315429] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2027.315502] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2027.315582] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8960cdd5-264d-45ae-a581-3531272dfbaa',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2027.316267] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-d7156740-676b-417b-9850-f10d741c20bd taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2027.316375] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d7156740-676b-417b-9850-f10d741c20bd" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2027.316439] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d7156740-676b-417b-9850-f10d741c20bd" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2027.316585] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d7156740-676b-417b-9850-f10d741c20bd" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2027.316743] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2027.316802] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2027.316864] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2027.316996] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2027.317081] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2027.317161] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d7156740-676b-417b-9850-f10d741c20bd',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2027.317924] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-948c6e1f-1c67-4d7c-bf02-0ca6a7c3cbda taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2027.318058] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-948c6e1f-1c67-4d7c-bf02-0ca6a7c3cbda" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2027.318093] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-948c6e1f-1c67-4d7c-bf02-0ca6a7c3cbda" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2027.318247] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-948c6e1f-1c67-4d7c-bf02-0ca6a7c3cbda" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2027.318385] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2027.318478] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2027.318539] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2027.318673] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2027.318747] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2027.318825] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('948c6e1f-1c67-4d7c-bf02-0ca6a7c3cbda',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2027.319520] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fab0830f-bae0-4a7a-851f-02ab1abad4a8 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2027.319627] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fab0830f-bae0-4a7a-851f-02ab1abad4a8" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2027.319693] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fab0830f-bae0-4a7a-851f-02ab1abad4a8" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2027.319839] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fab0830f-bae0-4a7a-851f-02ab1abad4a8" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2027.319911] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fab0830f-bae0-4a7a-851f-02ab1abad4a8',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2027.320600] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-61518cd2-637a-4fec-b890-2b6ae31ab7eb taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2027.320709] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-61518cd2-637a-4fec-b890-2b6ae31ab7eb" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2027.320774] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-61518cd2-637a-4fec-b890-2b6ae31ab7eb" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2027.320924] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-61518cd2-637a-4fec-b890-2b6ae31ab7eb" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2027.320997] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('61518cd2-637a-4fec-b890-2b6ae31ab7eb',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2027.323601] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2027.323695] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2027.323765] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2027.323917] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2027.323997] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2027.324181] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2027.324273] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2027.324333] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2027.324471] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2027.324546] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2027.324631] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 397559b2-3c5a-424d-b09d-43a25d2abba6 is going to be deleted. [ 2027.348427] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2027.348577] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2027.348618] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2027.348816] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2027.363776] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2027.363958] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2027.363958] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2027.364163] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2027.364251] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2027.364346] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-397559b2-3c5a-424d-b09d-43a25d2abba6" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2027.366285] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2027.366400] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 57c5faf9-ee2e-4964-943f-bc73f230e7dc is going to be deleted. [ 2027.410934] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2027.411137] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2027.411137] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2027.411353] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2027.411444] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2027.411571] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-57c5faf9-ee2e-4964-943f-bc73f230e7dc" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2027.823121] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2027.823510] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2027.823510] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2027.823594] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2027.823629] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2027.823808] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2027.823899] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2027.823960] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2027.824123] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2027.824202] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2027.824289] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 12570d95-0a4a-4579-82c8-53ecf65f714e is going to be deleted. [ 2027.825335] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2027.825443] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2027.825510] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2027.825659] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2027.825737] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2027.825918] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2027.826023] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2027.826083] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2027.826220] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2027.826293] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2027.826374] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8960cdd5-264d-45ae-a581-3531272dfbaa is going to be deleted. [ 2027.827289] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2027.827405] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2027.827472] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2027.827621] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2027.827697] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2027.827855] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2027.827948] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2027.828020] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2027.828159] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2027.828233] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2027.828315] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d7156740-676b-417b-9850-f10d741c20bd is going to be deleted. [ 2027.829133] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2027.829239] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2027.829307] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2027.829482] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2027.829559] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2027.829724] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2027.829818] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2027.829880] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2027.830028] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2027.830124] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2027.830180] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2a389e0c-0be3-41c9-986c-f4b06040a24d is going to be deleted. [ 2027.830959] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2027.831079] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2027.831147] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2027.831292] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2027.831369] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2027.831530] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2027.831626] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2027.831696] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2027.831823] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2027.831895] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2027.831977] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eb8c8265-ddd7-41a1-a435-066f89c523e5 is going to be deleted. [ 2027.834481] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2027.834614] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2027.834710] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2027.834806] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2027.834897] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2027.835085] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2027.835173] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2027.835235] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2027.835373] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2027.835448] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2027.835533] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fa6e8a6e-b63b-4248-b67b-4ae889fac90c is going to be deleted. [ 2027.836294] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2027.836400] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2027.836468] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2027.836615] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2027.836694] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2027.836854] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2027.836945] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2027.837013] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2027.837160] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2027.837234] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2027.837316] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 166e7c17-8917-425e-9cd8-0580f8aa3e74 is going to be deleted. [ 2027.838112] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2027.838219] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2027.838271] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2027.838389] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2027.838464] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2027.838626] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2027.838715] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2027.838775] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2027.838931] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2027.838999] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2027.839065] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f85bb0c6-bf80-4499-b5c3-0b4c4169bdc0 is going to be deleted. [ 2027.841398] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2027.841519] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2027.841565] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2027.841704] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2027.841795] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2027.841958] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2027.842062] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2027.842124] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2027.842260] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2027.842333] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2027.842427] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 22266528-0231-4142-81c2-081f9d6cd11d is going to be deleted. [ 2027.843186] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2027.843282] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2027.843350] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2027.843493] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2027.843571] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2027.843729] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2027.843818] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2027.843878] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2027.844021] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2027.844097] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2027.844176] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9f2518e8-b195-4520-b262-caa765ab7e27 is going to be deleted. [ 2027.844913] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2027.845027] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2027.845095] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2027.845241] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2027.845315] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2027.845473] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2027.845566] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2027.845624] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2027.845761] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2027.845823] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2027.845906] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c7e4a274-48d0-4c86-9db6-5b72611db3e7 is going to be deleted. [ 2027.847046] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2027.847153] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2027.847220] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2027.847399] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2027.847448] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2027.847596] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2027.847688] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2027.847748] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2027.847880] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2027.847952] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2027.848043] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2240419a-b1eb-469c-b2f2-8c54a91fa4b9 is going to be deleted. [ 2027.850085] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2027.850190] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2027.850258] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2027.850423] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2027.850511] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2027.850675] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2027.850766] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2027.850826] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2027.850963] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2027.851050] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2027.851133] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 948c6e1f-1c67-4d7c-bf02-0ca6a7c3cbda is going to be deleted. [ 2027.852195] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2027.852297] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2027.852364] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2027.852527] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2027.852606] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2027.852770] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2027.852857] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2027.852918] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2027.853063] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2027.853137] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2027.853218] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e1f5743d-088c-4b6d-9680-d1a339199c95 is going to be deleted. [ 2027.854254] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-49823780-57da-4d86-9e4f-035c5e58881c taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2027.854357] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-49823780-57da-4d86-9e4f-035c5e58881c" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2027.854423] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-49823780-57da-4d86-9e4f-035c5e58881c" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2027.854594] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-49823780-57da-4d86-9e4f-035c5e58881c" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2027.854736] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2027.854828] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2027.854890] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2027.855036] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2027.855111] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2027.855189] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-49823780-57da-4d86-9e4f-035c5e58881c" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2027.855275] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('49823780-57da-4d86-9e4f-035c5e58881c',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2027.856101] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2027.856210] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2027.856279] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2027.856427] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2027.856504] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2027.856662] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2027.856753] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2027.856817] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2027.856954] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2027.857047] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2027.857129] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2c6aa97b-8577-4c5e-8b88-1678798f98a7 is going to be deleted. [ 2027.900018] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2027.900171] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2027.900210] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2027.900411] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2027.906978] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2027.907084] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2027.933324] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2027.933449] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2027.933491] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2027.933665] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2027.933752] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2027.933846] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2240419a-b1eb-469c-b2f2-8c54a91fa4b9" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2027.934547] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2027.934664] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2027.934733] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2027.934886] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2027.934968] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2027.935070] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-12570d95-0a4a-4579-82c8-53ecf65f714e" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2027.935675] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2027.935781] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2027.935847] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2027.935993] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2027.936090] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2027.936204] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2c6aa97b-8577-4c5e-8b88-1678798f98a7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2027.936813] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2027.936920] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2027.936988] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2027.937148] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2027.937225] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2027.937315] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c7e4a274-48d0-4c86-9db6-5b72611db3e7" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2027.937954] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2027.938063] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2027.938132] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2027.938277] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2027.938356] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2027.938443] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e1f5743d-088c-4b6d-9680-d1a339199c95" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2027.939063] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2027.939170] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2027.939237] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2027.939452] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2027.939539] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2027.939632] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d7156740-676b-417b-9850-f10d741c20bd" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2027.940300] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2027.940410] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2027.940474] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2027.940640] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2027.940721] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2027.940807] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fa6e8a6e-b63b-4248-b67b-4ae889fac90c" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2027.941479] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2027.941586] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2027.941654] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2027.941807] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2027.941881] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2027.941969] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2a389e0c-0be3-41c9-986c-f4b06040a24d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2027.942610] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2027.942718] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2027.942786] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2027.942934] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2027.943024] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2027.943115] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f85bb0c6-bf80-4499-b5c3-0b4c4169bdc0" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2027.943625] env[69188]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 2027.944032] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2027.944154] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2027.944222] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2027.944392] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2027.944476] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2027.944566] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8960cdd5-264d-45ae-a581-3531272dfbaa" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2027.945128] env[69188]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 2027.945469] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2027.945577] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2027.945642] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2027.945790] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2027.945869] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2027.945956] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-22266528-0231-4142-81c2-081f9d6cd11d" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2027.946511] env[69188]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 2027.946832] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2027.946949] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2027.947032] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2027.947187] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2027.947271] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2027.947349] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eb8c8265-ddd7-41a1-a435-066f89c523e5" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2027.947872] env[69188]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 2027.948242] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2027.948348] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2027.948414] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2027.948584] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2027.948662] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2027.948752] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-948c6e1f-1c67-4d7c-bf02-0ca6a7c3cbda" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2027.949407] env[69188]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 2027.949799] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2027.949907] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fab0830f-bae0-4a7a-851f-02ab1abad4a8 is going to be deleted. [ 2027.950799] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2027.950955] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2027.952220] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2027.952327] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2027.952394] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2027.952549] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2027.952623] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2027.952709] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-166e7c17-8917-425e-9cd8-0580f8aa3e74" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2027.953619] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2027.953764] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2027.953838] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2027.953987] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2027.954077] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2027.954167] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9f2518e8-b195-4520-b262-caa765ab7e27" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2027.969731] env[69188]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 2027.970110] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2027.970213] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 61518cd2-637a-4fec-b890-2b6ae31ab7eb is going to be deleted. [ 2028.010739] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2028.010866] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2028.010918] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2028.011114] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2028.011198] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2028.011311] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fab0830f-bae0-4a7a-851f-02ab1abad4a8" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2028.019863] env[69188]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 2028.020301] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2028.020430] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2028.020507] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2028.020679] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2028.020757] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2028.020867] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-61518cd2-637a-4fec-b890-2b6ae31ab7eb" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2028.367816] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('49823780-57da-4d86-9e4f-035c5e58881c',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2028.870277] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 49823780-57da-4d86-9e4f-035c5e58881c: rpc.has_security_group_logging(os_id): False [ 2028.890962] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2028.891130] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2028.891171] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2028.891369] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2028.930974] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2028.931241] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2028.931351] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2028.931419] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2028.931588] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2028.931671] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2028.931757] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 49823780-57da-4d86-9e4f-035c5e58881c is going to be updated. [ 2029.018938] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2029.019144] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2029.019144] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2029.019289] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2029.019488] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2029.030199] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 49823780-57da-4d86-9e4f-035c5e58881c in Status: IN_PROGRESS for 2s [ 2031.044428] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 49823780-57da-4d86-9e4f-035c5e58881c in Status: SUCCESS [ 2031.044818] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-49823780-57da-4d86-9e4f-035c5e58881c" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2032.291381] env[69188]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2032.291837] env[69188]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2037.292639] env[69188]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2037.293071] env[69188]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2042.294253] env[69188]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2042.294660] env[69188]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2047.295961] env[69188]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2047.295961] env[69188]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2052.296447] env[69188]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2052.296801] env[69188]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2057.297434] env[69188]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2057.297732] env[69188]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2062.299006] env[69188]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2062.299300] env[69188]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2067.300286] env[69188]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2067.300621] env[69188]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2070.713397] env[69188]: INFO networking_nsxv3.common.synchronization [req-170de4e8-d783-4f43-bbcc-04e98fa994c9 req-7858e6ae-fda4-4a63-ac77-739ff384b3fa tempest-AttachVolumeNegativeTest-710486423 tempest-AttachVolumeNegativeTest-710486423-project-member] Enqueued Resource ID: 49823780-57da-4d86-9e4f-035c5e58881c with Priority: HIGHEST for action security_group_members [ 2070.713935] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 49823780-57da-4d86-9e4f-035c5e58881c with Priority: HIGHEST for action security_group_members [ 2070.714293] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-49823780-57da-4d86-9e4f-035c5e58881c taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2070.714451] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-49823780-57da-4d86-9e4f-035c5e58881c" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2070.714561] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-49823780-57da-4d86-9e4f-035c5e58881c" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2070.714764] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-49823780-57da-4d86-9e4f-035c5e58881c" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2070.714936] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2070.715079] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2070.715145] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2070.715341] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2070.715444] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2070.715551] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('49823780-57da-4d86-9e4f-035c5e58881c',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2071.217999] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2071.218176] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2071.218222] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2071.218404] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2071.218498] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2071.218693] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2071.218783] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2071.218847] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2071.218991] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2071.219080] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2071.219166] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 49823780-57da-4d86-9e4f-035c5e58881c is going to be updated. [ 2071.244525] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2071.244664] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2071.244702] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2071.244850] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2071.244982] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2071.253161] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 49823780-57da-4d86-9e4f-035c5e58881c in Status: IN_PROGRESS for 2s [ 2073.264119] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 49823780-57da-4d86-9e4f-035c5e58881c in Status: SUCCESS [ 2073.264474] env[69188]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 49823780-57da-4d86-9e4f-035c5e58881c deletion is rescheduled due to dependency. [ 2073.264474] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-49823780-57da-4d86-9e4f-035c5e58881c" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2075.328850] env[69188]: INFO networking_nsxv3.common.synchronization [None req-a1ad6fa1-73ee-4b29-9208-8948f2cd1357 tempest-AttachVolumeNegativeTest-710486423 tempest-AttachVolumeNegativeTest-710486423-project-member] Enqueued Resource ID: f232b95a-d9f1-4457-9e6c-2de7af4e4a37 with Priority: HIGHEST for action security_group_rules [ 2075.329363] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f232b95a-d9f1-4457-9e6c-2de7af4e4a37 with Priority: HIGHEST for action security_group_rules [ 2075.329664] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f232b95a-d9f1-4457-9e6c-2de7af4e4a37 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2075.329835] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f232b95a-d9f1-4457-9e6c-2de7af4e4a37" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2075.329902] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f232b95a-d9f1-4457-9e6c-2de7af4e4a37" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2075.330288] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f232b95a-d9f1-4457-9e6c-2de7af4e4a37" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2075.330525] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f232b95a-d9f1-4457-9e6c-2de7af4e4a37',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2075.389948] env[69188]: INFO networking_nsxv3.common.synchronization [None req-1cac36e8-46eb-4a11-b559-3c3f7e73e624 tempest-AttachVolumeNegativeTest-710486423 tempest-AttachVolumeNegativeTest-710486423-project-member] Enqueued Resource ID: f232b95a-d9f1-4457-9e6c-2de7af4e4a37 with Priority: HIGHEST for action security_group_rules [ 2075.390396] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f232b95a-d9f1-4457-9e6c-2de7af4e4a37 with Priority: HIGHEST for action security_group_rules [ 2075.390687] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f232b95a-d9f1-4457-9e6c-2de7af4e4a37 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2075.391015] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f232b95a-d9f1-4457-9e6c-2de7af4e4a37" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2075.851731] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2075.851895] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2075.851985] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2075.852175] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2075.852262] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2075.852362] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f232b95a-d9f1-4457-9e6c-2de7af4e4a37 already deleted. [ 2075.852446] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f232b95a-d9f1-4457-9e6c-2de7af4e4a37" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2075.852586] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f232b95a-d9f1-4457-9e6c-2de7af4e4a37" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2075.852740] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f232b95a-d9f1-4457-9e6c-2de7af4e4a37" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2075.852823] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f232b95a-d9f1-4457-9e6c-2de7af4e4a37',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2076.373030] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2076.373030] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2076.373030] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2076.373030] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2076.373030] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2076.373030] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f232b95a-d9f1-4457-9e6c-2de7af4e4a37 already deleted. [ 2076.373030] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f232b95a-d9f1-4457-9e6c-2de7af4e4a37" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2080.391457] env[69188]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2080.391768] env[69188]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2081.231852] env[69188]: INFO networking_nsxv3.common.synchronization [req-8e1b60bb-4c47-4f90-9ae9-c09276ad4d88 req-1e27b18c-9798-4756-8e6d-cc5d83a7da27 tempest-AttachVolumeNegativeTest-710486423 tempest-AttachVolumeNegativeTest-710486423-project-member] Enqueued Resource ID: f232b95a-d9f1-4457-9e6c-2de7af4e4a37 with Priority: HIGHEST for action security_group_members [ 2081.232287] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f232b95a-d9f1-4457-9e6c-2de7af4e4a37 with Priority: HIGHEST for action security_group_members [ 2081.232887] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-f232b95a-d9f1-4457-9e6c-2de7af4e4a37 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2081.232887] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f232b95a-d9f1-4457-9e6c-2de7af4e4a37" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2081.232887] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f232b95a-d9f1-4457-9e6c-2de7af4e4a37" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2081.233074] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f232b95a-d9f1-4457-9e6c-2de7af4e4a37" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2081.233198] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2081.233290] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2081.233358] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2081.233510] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2081.233594] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2081.233686] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f232b95a-d9f1-4457-9e6c-2de7af4e4a37',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2081.515842] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock network-655 taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2081.516136] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "network-655" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2081.516177] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "network-655" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2081.516443] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "network-655" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2081.516701] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2081.516860] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2081.516980] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2081.517201] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2081.517349] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2081.517564] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 2081.517679] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] NeedRegenerationException {{(pid=69188) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 2081.517840] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] no value, waiting for create lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 2081.517994] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] value creation lock acquired {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 2081.518140] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] No value present for key: 'zone-id' {{(pid=69188) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 2081.518259] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Calling creation function for not-yet-present value {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 2081.518482] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 2081.538396] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 2081.538550] env[69188]: DEBUG dogpile.cache.region [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69188) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 2081.538693] env[69188]: DEBUG dogpile.lock [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Released creation lock {{(pid=69188) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 2081.538861] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "network-655" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2081.539161] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock port-932cc129-cfa6-4505-b5d2-38af34c21a70 taken with stack trace [, , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2081.539323] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "port-932cc129-cfa6-4505-b5d2-38af34c21a70" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2081.539445] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "port-932cc129-cfa6-4505-b5d2-38af34c21a70" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2081.539730] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "port-932cc129-cfa6-4505-b5d2-38af34c21a70" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2081.539897] env[69188]: DEBUG networking_nsxv3.api.rpc [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('932cc129-cfa6-4505-b5d2-38af34c21a70',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2081.737062] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2081.737245] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2081.737245] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2081.737450] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2081.737540] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2081.737749] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2081.737864] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2081.737899] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2081.738051] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2081.738133] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2081.738219] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f232b95a-d9f1-4457-9e6c-2de7af4e4a37 already deleted. [ 2081.738294] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f232b95a-d9f1-4457-9e6c-2de7af4e4a37" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2082.042246] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2082.042464] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2082.042593] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2082.042870] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2082.043038] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2082.043199] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Segment Port 932cc129-cfa6-4505-b5d2-38af34c21a70 not found, creating... [ 2082.043451] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2082.043611] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2082.043733] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2082.043972] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2082.044116] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2082.044401] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2082.044562] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2082.044681] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2082.044892] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2082.045048] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2082.045190] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Resource: SegmentPort with ID: 932cc129-cfa6-4505-b5d2-38af34c21a70 is going to be created. [ 2082.065882] env[69188]: DEBUG networking_nsxv3.common.locking [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2082.066062] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2082.066175] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2082.066406] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2082.066626] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2082.066836] env[69188]: DEBUG oslo_concurrency.lockutils [None req-aed1f05a-41a8-468d-aed3-e55d0a2b0032 None None] Releasing lock "port-932cc129-cfa6-4505-b5d2-38af34c21a70" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2082.725586] env[69188]: INFO networking_nsxv3.common.synchronization [req-8e1b60bb-4c47-4f90-9ae9-c09276ad4d88 req-dbec2c28-2dfd-4392-b290-e23a9a311d89 service nova] Enqueued Resource ID: f232b95a-d9f1-4457-9e6c-2de7af4e4a37 with Priority: HIGHEST for action security_group_rules [ 2082.725850] env[69188]: INFO networking_nsxv3.common.synchronization [req-8e1b60bb-4c47-4f90-9ae9-c09276ad4d88 req-dbec2c28-2dfd-4392-b290-e23a9a311d89 service nova] Enqueued Resource ID: f232b95a-d9f1-4457-9e6c-2de7af4e4a37 with Priority: HIGHEST for action security_group_members [ 2082.726093] env[69188]: INFO networking_nsxv3.common.synchronization [req-8e1b60bb-4c47-4f90-9ae9-c09276ad4d88 req-dbec2c28-2dfd-4392-b290-e23a9a311d89 service nova] Enqueued Resource ID: 932cc129-cfa6-4505-b5d2-38af34c21a70 with Priority: HIGHEST for action port [ 2082.726418] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f232b95a-d9f1-4457-9e6c-2de7af4e4a37 with Priority: HIGHEST for action security_group_rules [ 2082.726624] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f232b95a-d9f1-4457-9e6c-2de7af4e4a37 with Priority: HIGHEST for action security_group_members [ 2082.726780] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 932cc129-cfa6-4505-b5d2-38af34c21a70 with Priority: HIGHEST for action port [ 2082.727367] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f232b95a-d9f1-4457-9e6c-2de7af4e4a37 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2082.727495] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f232b95a-d9f1-4457-9e6c-2de7af4e4a37" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2082.727562] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f232b95a-d9f1-4457-9e6c-2de7af4e4a37" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2082.727782] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f232b95a-d9f1-4457-9e6c-2de7af4e4a37" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2082.727881] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f232b95a-d9f1-4457-9e6c-2de7af4e4a37',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2082.728749] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-f232b95a-d9f1-4457-9e6c-2de7af4e4a37 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2082.728860] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f232b95a-d9f1-4457-9e6c-2de7af4e4a37" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2082.728927] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f232b95a-d9f1-4457-9e6c-2de7af4e4a37" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2082.729107] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f232b95a-d9f1-4457-9e6c-2de7af4e4a37" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2082.729636] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2082.729745] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2082.729813] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2082.729981] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2082.730083] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2082.730171] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f232b95a-d9f1-4457-9e6c-2de7af4e4a37',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2082.730893] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock port-932cc129-cfa6-4505-b5d2-38af34c21a70 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2082.731019] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-932cc129-cfa6-4505-b5d2-38af34c21a70" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2082.731071] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-932cc129-cfa6-4505-b5d2-38af34c21a70" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2082.731212] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-932cc129-cfa6-4505-b5d2-38af34c21a70" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2082.731277] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('932cc129-cfa6-4505-b5d2-38af34c21a70',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2083.234617] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-f232b95a-d9f1-4457-9e6c-2de7af4e4a37 taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2083.234759] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f232b95a-d9f1-4457-9e6c-2de7af4e4a37" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2083.234942] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f232b95a-d9f1-4457-9e6c-2de7af4e4a37',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2083.235831] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 932cc129-cfa6-4505-b5d2-38af34c21a70 with status ACTIVE [ 2083.236091] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2083.236265] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2083.236369] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2083.236663] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2083.236805] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2083.237061] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2083.237214] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2083.237319] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2083.237547] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2083.237676] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2083.237955] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2083.238166] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2083.238255] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2083.238415] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2083.238539] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2083.238654] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 932cc129-cfa6-4505-b5d2-38af34c21a70 is going to be updated. [ 2083.258494] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2083.258632] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2083.258670] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2083.258815] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2083.258933] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2083.259106] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-932cc129-cfa6-4505-b5d2-38af34c21a70" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2083.741650] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f232b95a-d9f1-4457-9e6c-2de7af4e4a37',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2084.243852] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2084.244078] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2084.244128] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2084.244403] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2084.244524] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2084.244650] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f232b95a-d9f1-4457-9e6c-2de7af4e4a37 is going to be created. [ 2084.265808] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2084.265976] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2084.266113] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2084.266321] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2084.266472] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2084.274328] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f232b95a-d9f1-4457-9e6c-2de7af4e4a37 in Status: UNINITIALIZED for 2s [ 2086.285046] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f232b95a-d9f1-4457-9e6c-2de7af4e4a37 in Status: SUCCESS [ 2086.285046] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f232b95a-d9f1-4457-9e6c-2de7af4e4a37" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2086.285046] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f232b95a-d9f1-4457-9e6c-2de7af4e4a37" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2086.285478] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f232b95a-d9f1-4457-9e6c-2de7af4e4a37" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2086.285478] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2086.285576] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2086.285576] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2086.285732] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2086.285814] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2086.285901] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f232b95a-d9f1-4457-9e6c-2de7af4e4a37" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2086.285992] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f232b95a-d9f1-4457-9e6c-2de7af4e4a37',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2086.788420] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f232b95a-d9f1-4457-9e6c-2de7af4e4a37',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2087.292050] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f232b95a-d9f1-4457-9e6c-2de7af4e4a37: rpc.has_security_group_logging(os_id): False [ 2087.311538] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2087.311686] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2087.311742] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2087.311935] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2087.312039] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2087.312269] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2087.312369] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2087.312434] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2087.312589] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2087.312666] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2087.312752] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f232b95a-d9f1-4457-9e6c-2de7af4e4a37 is going to be created. [ 2087.366474] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2087.366664] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2087.366664] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2087.366823] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2087.366990] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2087.376480] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f232b95a-d9f1-4457-9e6c-2de7af4e4a37 in Status: IN_PROGRESS for 2s [ 2087.728264] env[69188]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2087.728433] env[69188]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 2089.389467] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f232b95a-d9f1-4457-9e6c-2de7af4e4a37 in Status: SUCCESS [ 2089.389792] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f232b95a-d9f1-4457-9e6c-2de7af4e4a37" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2092.729374] env[69188]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2092.729638] env[69188]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2097.730277] env[69188]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2097.730625] env[69188]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2102.730986] env[69188]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2102.731298] env[69188]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2107.732623] env[69188]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2107.732963] env[69188]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2112.733662] env[69188]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2112.733938] env[69188]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2117.735316] env[69188]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2117.735316] env[69188]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2122.736033] env[69188]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2122.736288] env[69188]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2127.737552] env[69188]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2127.737797] env[69188]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2132.739118] env[69188]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2132.739400] env[69188]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2137.740058] env[69188]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2137.740311] env[69188]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2142.740615] env[69188]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2142.740900] env[69188]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2144.608243] env[69188]: INFO networking_nsxv3.common.synchronization [req-91594440-15d6-40a0-bb41-dcb5d4535cf9 req-2389990f-857d-42e3-b44e-76af49d0cb44 tempest-AttachVolumeNegativeTest-710486423 tempest-AttachVolumeNegativeTest-710486423-project-member] Enqueued Resource ID: f232b95a-d9f1-4457-9e6c-2de7af4e4a37 with Priority: HIGHEST for action security_group_members [ 2144.608798] env[69188]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f232b95a-d9f1-4457-9e6c-2de7af4e4a37 with Priority: HIGHEST for action security_group_members [ 2144.609124] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock member-f232b95a-d9f1-4457-9e6c-2de7af4e4a37 taken with stack trace [, , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2144.609258] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f232b95a-d9f1-4457-9e6c-2de7af4e4a37" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2144.609327] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f232b95a-d9f1-4457-9e6c-2de7af4e4a37" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2144.609549] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f232b95a-d9f1-4457-9e6c-2de7af4e4a37" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2144.609744] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2144.609807] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2144.609847] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2144.609986] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2144.610103] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2144.610196] env[69188]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f232b95a-d9f1-4457-9e6c-2de7af4e4a37',) {} {{(pid=69188) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2145.112622] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2145.112884] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2145.112884] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2145.113016] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2145.113396] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2145.113396] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2145.113612] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2145.113612] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2145.113722] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2145.113856] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2145.113987] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f232b95a-d9f1-4457-9e6c-2de7af4e4a37 is going to be updated. [ 2145.147361] env[69188]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69188) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2145.147554] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2145.147554] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2145.147674] env[69188]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2145.147808] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2145.155573] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f232b95a-d9f1-4457-9e6c-2de7af4e4a37 in Status: IN_PROGRESS for 2s [ 2147.165753] env[69188]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f232b95a-d9f1-4457-9e6c-2de7af4e4a37 in Status: SUCCESS [ 2147.166096] env[69188]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f232b95a-d9f1-4457-9e6c-2de7af4e4a37 deletion is rescheduled due to dependency. [ 2147.166096] env[69188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f232b95a-d9f1-4457-9e6c-2de7af4e4a37" {{(pid=69188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2149.609817] env[69188]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2149.609817] env[69188]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2154.610875] env[69188]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2154.611246] env[69188]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2159.612274] env[69188]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2159.612628] env[69188]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2164.613449] env[69188]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2164.613869] env[69188]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2169.614957] env[69188]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2169.614957] env[69188]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2174.615895] env[69188]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2174.616243] env[69188]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2179.617072] env[69188]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2179.617435] env[69188]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0